-- Logs begin at Wed 2022-08-24 15:02:55 UTC, end at Wed 2022-08-24 16:02:26 UTC. -- Aug 24 15:30:54.471039 dv-cinder-846054-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 15:30:54.482076 dv-cinder-846054-2-smb devstack@keystone.service[88158]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:30:54 2022] *** Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: nodename: dv-cinder-846054-2-smb Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: machine: x86_64 Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: clock source: unix Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: pcre jit disabled Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: detected number of CPU cores: 4 Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: current working directory: / Aug 24 15:30:54.484128 dv-cinder-846054-2-smb devstack@keystone.service[88158]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: your processes number limit is 47680 Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: your memory page size is 4096 bytes Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: detected max file descriptor number: 2048 Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: lock engine: pthread robust mutexes Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: thunder lock: enabled Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 15:30:54.484768 dv-cinder-846054-2-smb devstack@keystone.service[88158]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:30:54.522786 dv-cinder-846054-2-smb devstack@keystone.service[88158]: Python main interpreter initialized at 0x5652f99399c0 Aug 24 15:30:54.522786 dv-cinder-846054-2-smb devstack@keystone.service[88158]: python threads support enabled Aug 24 15:30:54.522786 dv-cinder-846054-2-smb devstack@keystone.service[88158]: your server socket listen backlog is limited to 100 connections Aug 24 15:30:54.522786 dv-cinder-846054-2-smb devstack@keystone.service[88158]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:30:54.523126 dv-cinder-846054-2-smb devstack@keystone.service[88158]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:30:54.523206 dv-cinder-846054-2-smb devstack@keystone.service[88158]: *** Operational MODE: preforking *** Aug 24 15:30:54.523467 dv-cinder-846054-2-smb devstack@keystone.service[88158]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:30:54.523467 dv-cinder-846054-2-smb devstack@keystone.service[88158]: spawned uWSGI master process (pid: 88158) Aug 24 15:30:54.524003 dv-cinder-846054-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 15:30:54.524806 dv-cinder-846054-2-smb devstack@keystone.service[88158]: spawned uWSGI worker 1 (pid: 88171, cores: 1) Aug 24 15:30:54.524806 dv-cinder-846054-2-smb devstack@keystone.service[88158]: spawned uWSGI worker 2 (pid: 88172, cores: 1) Aug 24 15:30:54.525005 dv-cinder-846054-2-smb devstack@keystone.service[88158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:30:58.723792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:30:58.723792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: from cryptography.utils import int_from_bytes Aug 24 15:30:58.724644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:30:58.724644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: from cryptography.utils import int_from_bytes Aug 24 15:30:58.725111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:30:58.725111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: from cryptography.utils import int_from_bytes Aug 24 15:30:58.725222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:30:58.725222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: from cryptography.utils import int_from_bytes Aug 24 15:30:58.773396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:30:58.773955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:30:58.774055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:30:58.774144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] command line args: [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:30:58.774219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:30:58.774351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:30:58.774451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] command line args: [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:30:58.774527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ================================================================================ {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:30:58.774648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:30:58.774765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] admin_token = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.774842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ================================================================================ {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:30:58.775025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] config_dir = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] admin_token = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] config_dir = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] config_source = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] debug = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] config_source = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.775981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] debug = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.776982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_config_append = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_config_append = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_dir = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_file = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_dir = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_file = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.777970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.778926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.779975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.780949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] publish_errors = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.781889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.93/identity {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] publish_errors = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.782857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] standard_threads = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] standard_threads = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.783940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] use_journal = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] use_json = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] use_journal = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] use_stderr = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] use_json = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] use_syslog = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] use_stderr = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] use_syslog = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.784830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.784938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:30:58.785058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.785935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.786695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.787943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.788954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.789084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.789194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.789350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.789569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.789746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.790925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.791971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.792858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.793996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.794926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.795975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.796152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.796382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.796632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.796850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.797998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.798920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.799964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.800994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.801877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.802734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.803990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.804959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.805894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.806937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.807878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.808822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.809990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.810963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.external = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.811932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.password = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] auth.token = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.812989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.external = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.813960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.password = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.814935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] auth.token = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.815978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.816859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817623 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.817927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.818899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.819890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.820875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.821869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.822824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.823940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.824983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.825995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.826959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.827932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.828918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.829878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.830988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.831982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.832941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.833831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.834978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.835923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.836880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.837957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.838898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.839854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.840867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.841839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.842969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.843923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] role.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.844873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] role.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.845934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.846901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] role.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] role.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.847863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.848957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.849972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.850947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.851921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.852923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.853886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.854838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.855983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.856954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.connection = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.857937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.858997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.859934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.connection = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.860966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.861881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:30:58.862274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.862970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.863212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.863453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.863701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.863935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.864179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.864412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.864653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.864888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:30:58.865077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:30:58.891585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.891819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.892050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.893380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.893617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.893832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.900932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.902705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.929225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.929482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.931078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.931308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.982916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:58.983358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.031457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.031739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.032255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.032499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.191964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.192129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.192254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.192339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.192539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.215277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.215538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.215737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.215810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.215988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.216830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.217072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.227994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.228285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.240947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.241985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.242888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88171) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 15:30:59.258910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.259109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:30:59.259236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.259409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:30:59.259532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.259626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:30:59.259706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.259932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.260061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 15:30:59.260178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.260285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.260457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.260688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.260999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.261126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.261268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.270411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.270573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.270666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.270887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.271012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.271133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.271224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.271446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.278569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.278696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.281486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.281615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.281751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.281876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.282864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.283959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.284099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.284232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.284360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.284489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.306697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.306823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.308148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.308276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.308397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.308554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.313149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.313278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.313432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.313557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.313689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.313783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.319969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.320093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.320256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.320380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.324362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.324488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.324648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.324773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.324921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.325899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.326033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.326160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.326325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.326450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.343445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.343586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.343702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.343794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.347590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.347753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.350825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.350951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.351117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.351242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.355285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.355410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.358469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.358595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.361707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.361852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.362998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.363128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.363264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.378866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.378990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.379163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.379287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.379402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.379512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.379709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.379834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.386562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.386686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.388091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.388219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.388370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.388492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.391130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.391244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.391988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.392105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.392197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.403674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.403873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.403981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.404835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.405063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.405297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.405399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.405529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.420470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.420676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.423484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.423685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.426367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.426674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.427785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.428111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.429282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.429532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.429654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.429849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.429975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.430173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.436286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.436724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.437762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.438205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.440702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.441895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.449473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.449788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.449965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.450098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.450242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.450443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.456848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88171) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.457161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.457284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 15:30:59.457458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.457592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.457722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.457802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.457921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.458896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.459971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.460142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.460277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.460401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88171) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.460524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.460785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 15:30:59.494033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652f99399c0 pid: 88171 (default app) Aug 24 15:30:59.494613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652f99399c0 pid: 88172 (default app) Aug 24 15:30:59.497511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c96ef-b025-4397-990f-075b3ac47d23 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:30:59.497796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c96ef-b025-4397-990f-075b3ac47d23 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:30:59.498071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c96ef-b025-4397-990f-075b3ac47d23 None None] PATH_INFO: `/v3` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:30:59.502356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 791 bytes} [Wed Aug 24 15:30:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:06.101147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:06.101992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:06.101992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:06.109061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:06.119889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:06.120329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:06.120468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:06.194863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: INFO dbcounter [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] Registered counter for database keystone Aug 24 15:31:06.216561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:31:06.226114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writer thread running {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:31:06.418775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG passlib.handlers.bcrypt [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88171) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 15:31:06.419121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG passlib.handlers.bcrypt [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88171) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 15:31:06.474035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:06.475640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:06.619927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 2/3] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 15:31:07.117724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:07.187997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: INFO dbcounter [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] Registered counter for database keystone Aug 24 15:31:07.213077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG oslo_db.sqlalchemy.engines [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:31:07.221122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writer thread running {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:31:07.343865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763358b-b9dc-4a1e-b918-b06269f164eb None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:07.349409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:07.350048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:07.350329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:07.350595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:07.359779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:07.410345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 15:31:07.410623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffaaa9-1bec-4035-9011-6b6afd5aa9cc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:07.420888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1324 bytes} [Wed Aug 24 15:31:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:31:07.430926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:07.453598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ffa6a-afbb-4ab1-9834-7784d2b85598 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:07.460053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:07.461223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:07.461500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:07.461766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] PATH_INFO: `/v3/projects/91eb9a5b14d843409de915748f661903` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:07.463511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] RBAC: Authorizing `identity:get_project(project_id=91eb9a5b14d843409de915748f661903)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:07.515387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 15:31:07.515723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eec70-41bc-43f3-9369-402bd859ff7a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:07.520364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 3/5] 10.222.0.93 () {56 vars in 1207 bytes} [Wed Aug 24 15:31:07 2022] GET /identity/v3/projects/91eb9a5b14d843409de915748f661903 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:09.377751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc17e3-9c70-4fb7-af41-279a2e1546fd None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:09.378679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc17e3-9c70-4fb7-af41-279a2e1546fd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:09.378679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc17e3-9c70-4fb7-af41-279a2e1546fd None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:09.385548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 3/6] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:09.393849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:09.394319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:09.394414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:09.418151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:09.419698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:09.429957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 4/7] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 15:31:09.701777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc17e3-9c70-4fb7-af41-279a2e1546fd None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:09.723906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc17e3-9c70-4fb7-af41-279a2e1546fd None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:09.732143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:09.732755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:09.733059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:09.733332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:09.741279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:09.743087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4aeeb6-a030-4190-b12f-55c1f00ca18c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:09.751708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 4/8] 10.222.0.93 () {58 vars in 1324 bytes} [Wed Aug 24 15:31:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:31:09.758062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:09.772971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0180706-56e6-45fc-9b5b-212f6052d77c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:09.780885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:09.781550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:09.781819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:09.782085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:09.783554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:09.785473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a788a7-27d1-46ff-bf73-44b21c1cb72b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:09.787002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 5/9] 10.222.0.93 () {56 vars in 1198 bytes} [Wed Aug 24 15:31:09 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:11.736373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936c6f6-6077-4aea-929d-1dd0d31ad063 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:11.736980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936c6f6-6077-4aea-929d-1dd0d31ad063 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:11.736980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936c6f6-6077-4aea-929d-1dd0d31ad063 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:11.738302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:11.743779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:11.744218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:11.744313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:11.763526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:11.764707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:11.771068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316947d9-cc3a-4de5-80eb-2c3c0513a4d6 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:11.771347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316947d9-cc3a-4de5-80eb-2c3c0513a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:11.771614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316947d9-cc3a-4de5-80eb-2c3c0513a4d6 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:11.772960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 6/11] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:11.778161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:11.778507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:11.778780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:11.820273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG passlib.handlers.bcrypt [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88172) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 15:31:11.820669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG passlib.handlers.bcrypt [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88172) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 15:31:11.850192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 6/12] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:11.865659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:11.867270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:11.968594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 7/13] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:12.113466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.138479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.225906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eafa0-04c4-417e-a66d-bdc5cb6467a9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.228613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.262817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.263461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.263737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.264006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.275545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:12.284375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:12.285315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:12.286165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:12.289041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 7/14] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:12.291353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.332437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49550-6597-4abb-a126-09b8333bb715 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.334744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.369528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.370328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.370606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.370875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.375634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.393338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a822-0fde-4d9b-b4c6-0539021d373c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.428100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.428720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.429023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.429296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.429967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:12.430265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.431676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.437378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.438901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.443252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 8/15] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:12.449076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.538281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 8/16] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:12.543928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.546597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.551106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa121d-998f-49c2-8e06-6176490422bc None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.585571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.586512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.586932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.587210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.588377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.589903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.591511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 9/17] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:12.597311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.611815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.640441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fea31f-5d6f-4c6f-a060-04093ddefcd7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.673797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.674664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.674941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.675211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.693815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.695289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.695580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cb21d-ffbe-456d-80b1-e3f8ae9260e6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:31:12.713663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:12.714613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:31:12.715497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:31:12.715497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:31:12.715497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:12.715497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 9/18] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:31:12.720640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.729618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.730341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.730622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.730896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.732215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.733720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.735290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 10/19] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:12.741090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:12.778201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.823233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d000082-3573-4e81-b390-bcdc33409c18 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.823419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.842503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48059f-7594-4869-8114-6bcb2374f8a1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:12.856885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.857555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.857834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.858096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.858715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:12.859020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.860431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50088a25-8f9a-48f7-93d3-e65134fe2fb4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.876523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:12.877166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:12.877440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:12.877711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:12.878433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.domain.id=default, user.id=61343595c90645119bdcdf769e315d4c) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:12.878726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:12.878853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 10/20] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:12.880196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6c90-ef6a-4323-9fca-273f64d80718 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:12.887315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 11/21] 10.222.0.93 () {56 vars in 1322 bytes} [Wed Aug 24 15:31:12 2022] GET /identity/v3/role_assignments?user.id=61343595c90645119bdcdf769e315d4c&scope.domain.id=default&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:14.884032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafc18-318a-44eb-8b95-6751d0eecbfb None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:14.884563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafc18-318a-44eb-8b95-6751d0eecbfb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:14.884563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafc18-318a-44eb-8b95-6751d0eecbfb None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:14.886231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 11/22] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:14.891670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47d01-b9ee-4317-974b-e2172662ae18 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:14.892484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47d01-b9ee-4317-974b-e2172662ae18 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:14.892988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47d01-b9ee-4317-974b-e2172662ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:14.920844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9ea47d01-b9ee-4317-974b-e2172662ae18 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:14.922492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9ea47d01-b9ee-4317-974b-e2172662ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:15.014946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 12/23] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:15.253398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e9a2-47db-40f0-90e0-89f0fa1e7bac None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.254013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e9a2-47db-40f0-90e0-89f0fa1e7bac None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.254513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e9a2-47db-40f0-90e0-89f0fa1e7bac None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.256106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 12/24] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:15.268142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0de9-5d9a-4b5d-82ca-018ed6867a97 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.268719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0de9-5d9a-4b5d-82ca-018ed6867a97 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.269224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0de9-5d9a-4b5d-82ca-018ed6867a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.293098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8d9f0de9-5d9a-4b5d-82ca-018ed6867a97 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:15.294706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8d9f0de9-5d9a-4b5d-82ca-018ed6867a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:15.382979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 13/25] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:15.417253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9739-939d-45ed-bb0b-7e49f3f909dc None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.418069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9739-939d-45ed-bb0b-7e49f3f909dc None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.418795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec9739-939d-45ed-bb0b-7e49f3f909dc None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.421158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 13/26] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:15.427252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabecd3-b856-4e19-97ed-e9dbb3b145ba None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.427959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabecd3-b856-4e19-97ed-e9dbb3b145ba None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.428612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabecd3-b856-4e19-97ed-e9dbb3b145ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.444088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:15.462575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1dabecd3-b856-4e19-97ed-e9dbb3b145ba None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:15.463840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1dabecd3-b856-4e19-97ed-e9dbb3b145ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:15.493833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec9739-939d-45ed-bb0b-7e49f3f909dc None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:15.571220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 14/27] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:15.647063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbac2e-5510-437b-8e3f-61bc4e8b95f3 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.647731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbac2e-5510-437b-8e3f-61bc4e8b95f3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.648220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbac2e-5510-437b-8e3f-61bc4e8b95f3 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.650149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 15/28] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:15.652998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec9739-939d-45ed-bb0b-7e49f3f909dc None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:15.655607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.656101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.656586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.678419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:15.690947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:15.692494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:15.713624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:15.714333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:15.714528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:15.714799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:15.741758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:15.748656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:15.749537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:15.750322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 14/29] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:31:15.755884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:15.803197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 16/30] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:15.882104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:15.953335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:15.971152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c37c2f-4335-4a7f-9da8-7ffc31a4626b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:15.996247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b78900-5bb6-4012-b7fe-f41ba0488ed6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.033736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.034711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.035186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.035704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.036578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.038211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.053735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.054387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.054667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.054991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.055819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:16.056013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.057536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.088361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 15/31] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:16.089283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.137346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:16.168591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 17/32] 10.222.0.93 () {60 vars in 1131 bytes} [Wed Aug 24 15:31:15 2022] POST /identity/v3/roles => generated 219 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:31:16.174232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.259749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b534c-c6e9-417a-920d-308b24e89444 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.308414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.309010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.309467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.309739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.310429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.311872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.381371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd99e1-125a-498b-a282-c043ad0c2f84 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.424891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:16.437248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.437906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.438183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.438747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.439700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.441307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.442916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 18/33] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:16 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:16.443771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.499626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 16/34] 10.222.0.93 () {60 vars in 1131 bytes} [Wed Aug 24 15:31:16 2022] POST /identity/v3/roles => generated 225 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:16.501017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.578500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1dba8-e13a-4dd7-abb4-32bb7eee0179 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.622045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead4b1c-3a70-41d6-a94c-817260e423c6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.637354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:16.663653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.664774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.665289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.665804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.667843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.669947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0adf8a-a024-4199-ac6f-fb24fdf09730 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.672239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 17/35] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:16.673849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391592b6-55ee-4e24-9107-5deac6cda199 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.674341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391592b6-55ee-4e24-9107-5deac6cda199 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.674814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391592b6-55ee-4e24-9107-5deac6cda199 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.676356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 18/36] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:16.677690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391592b6-55ee-4e24-9107-5deac6cda199 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.692552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.693253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.693519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.693789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.706457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.707988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-37f1741a-7a4a-41ba-9124-d827a4e76546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:31:16.726713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:16.727628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:31:16.728448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:31:16.728448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:31:16.728448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:16.728448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 19/37] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:16.732843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.732843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.732843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.757284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:16.758807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:16.808158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:16.808810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391592b6-55ee-4e24-9107-5deac6cda199 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.836416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 20/38] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:16.841801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:16.845302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:16.846170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.846675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.847164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] PATH_INFO: `/v3/domains/default/users/61343595c90645119bdcdf769e315d4c/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.849777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=61343595c90645119bdcdf769e315d4c, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:16.851645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5788be3-6bf2-4a75-9ffa-60e6a2b9083a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:16.873384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 19/39] 10.222.0.93 () {58 vars in 1361 bytes} [Wed Aug 24 15:31:16 2022] PUT /identity/v3/domains/default/users/61343595c90645119bdcdf769e315d4c/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:31:16.966422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc139-dc44-4edd-b09d-588d1a13d710 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:16.973174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8433-f39c-4949-92a9-ee70517eda16 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.973676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8433-f39c-4949-92a9-ee70517eda16 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.973777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8433-f39c-4949-92a9-ee70517eda16 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:16.975168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 20/40] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:16.981423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:16.982188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:16.982693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.004247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:17.006364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:17.033928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:17.100473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 21/41] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:17.120361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:17.121104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:17.121387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:17.121690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.122348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:17.122651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:17.124209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:17.126732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:17.142508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 21/42] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:17.151147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:17.186715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:17.254348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93760e-6385-4e10-9d52-b472768dc235 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:17.267357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d172-e7aa-486a-a291-af72c1eccb95 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:17.292691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:17.293459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:17.293739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:17.294014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.294754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:17.296168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:17.313364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:17.314083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 22/43] 10.222.0.93 () {60 vars in 1131 bytes} [Wed Aug 24 15:31:17 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:31:17.314585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:17.315154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:17.315649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.316590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:17.318369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:17.354807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 22/44] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:31:17 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:31:17.377688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:17.402905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:17.508312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c149c-ed5e-4e32-a77c-b42b0c682da4 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:17.552398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:17.553091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:17.553365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:17.553629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.554764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:17.556226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529f2d4-af15-41a1-9c03-598ead4390cf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:17.558172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 23/45] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:17.563821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:17.656294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:17.673307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17e082-c1fc-41ab-99bb-1eda862a1680 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:17.709749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:17.710400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:17.710681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:17.710960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:17.711626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:17.713129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38dcc1-fa8e-44de-9939-c6941365179d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:17.741506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 23/46] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:31:17 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:31:18.875642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaebda6-f7ec-49d8-93e7-0e2dab5c73ff None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:18.876170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaebda6-f7ec-49d8-93e7-0e2dab5c73ff None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:18.876170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaebda6-f7ec-49d8-93e7-0e2dab5c73ff None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:18.877595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 24/47] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:18.883035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:18.883509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:18.883603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:18.903281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:18.904481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:18.973537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 24/48] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:19.236012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaebda6-f7ec-49d8-93e7-0e2dab5c73ff None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:19.324425 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:19.342178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaebda6-f7ec-49d8-93e7-0e2dab5c73ff None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:19.378190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:19.378829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.379108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.379381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.390728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:19.395495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:19.396370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:19.397240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 25/49] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:19.403005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:19.468443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:19.503601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3afaf-9c2c-485e-b427-b9189b441663 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:19.540194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:19.540817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.541123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.541392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.542060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:19.542374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:19.543793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cff4f5-f3b8-4d98-a6dc-e41117ff9846 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:19.555588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 25/50] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:19.562535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:19.650101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a578-7d24-45e5-9eda-920b4fb7226d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.650412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a578-7d24-45e5-9eda-920b4fb7226d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.650770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a578-7d24-45e5-9eda-920b4fb7226d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.652727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 26/51] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:19.658096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.658378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.658653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.672302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1071e-d750-4618-883b-1a1820533578 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:19.678912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:19.680157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:19.711233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:19.711851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.712128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.712402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.713582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:19.715052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:19.716744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 26/52] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:19 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:19.722481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:19.737195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:19.750771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 27/53] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:19.821329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eec4a-d1b7-4569-ab70-53b91fd277fa None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:19.855790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:19.856421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:19.856752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:19.857056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:19.858225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:19.859689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:19.861278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 27/54] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:19.867308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:19.925819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:19.970554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d438-8286-41b1-a43f-0565ec63f644 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:20.006369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:20.006983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:20.007261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:20.007537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:20.008269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.domain.id=default, user.id=61343595c90645119bdcdf769e315d4c) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:20.008570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:20.010073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:20.013771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:20.022093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 28/55] 10.222.0.93 () {56 vars in 1322 bytes} [Wed Aug 24 15:31:19 2022] GET /identity/v3/role_assignments?user.id=61343595c90645119bdcdf769e315d4c&scope.domain.id=default&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:20.104728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:20.125551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8a5f4-10e1-488f-afc0-80000291f9fc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:20.166637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:20.167283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:20.168240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:20.168240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:20.169279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:20.170744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d925-d02a-4ce5-8bf7-96dbb4b65b3e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:20.172311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 28/56] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:20.178198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:20.292428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e840-7e22-4010-b4f3-9a5ac13ff4d5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:20.324761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:20.336764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:20.337413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:20.337692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:20.337964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:20.338626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:20.340099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03451ed2-32da-45f0-892b-61c0ea6e86f2 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:20.368555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 29/57] 10.222.0.93 () {60 vars in 1140 bytes} [Wed Aug 24 15:31:20 2022] POST /identity/v3/projects => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:22.255407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cbb-5a1e-46d1-83b9-a1378a8a9026 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:22.256164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cbb-5a1e-46d1-83b9-a1378a8a9026 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:22.256281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cbb-5a1e-46d1-83b9-a1378a8a9026 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:22.258584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 29/58] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:22.264038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:22.264457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:22.264542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:22.286903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:22.288088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:22.357187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 30/59] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:22.620218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0cbb-5a1e-46d1-83b9-a1378a8a9026 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:22.747595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0cbb-5a1e-46d1-83b9-a1378a8a9026 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:22.784350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:22.785031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:22.785303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:22.785574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:22.786834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:22.788298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065c3d2-6f7f-44a8-8f06-3305e2fc4285 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:22.789889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 30/60] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:22.798573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:22.909953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca23d9-8d4c-4342-be3a-83bf7f1115fc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:22.917349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:22.949361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:22.950021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:22.950296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:22.950566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:22.951208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:22.952679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12052374-36b3-4e7c-9171-1ac2400559e2 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:22.981633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 31/61] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:22 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:25.865653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6bc1-7aa8-4c61-b7fd-94acceaa887b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:25.866703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6bc1-7aa8-4c61-b7fd-94acceaa887b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:25.867183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee6bc1-7aa8-4c61-b7fd-94acceaa887b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:25.868731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 31/62] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:25.874449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:25.874884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:25.875004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:25.896123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:25.897670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:25.929807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7788-3bfc-41dc-9417-c89b2eb0fdcb None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:25.930115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7788-3bfc-41dc-9417-c89b2eb0fdcb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:25.930366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd7788-3bfc-41dc-9417-c89b2eb0fdcb None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:25.931701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 32/63] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:25.944628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d849f2-8e0b-462a-b0c1-5c69abe718e5 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:25.945393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d849f2-8e0b-462a-b0c1-5c69abe718e5 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:25.945871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d849f2-8e0b-462a-b0c1-5c69abe718e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:25.967567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e5d849f2-8e0b-462a-b0c1-5c69abe718e5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:25.969840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e5d849f2-8e0b-462a-b0c1-5c69abe718e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:25.989326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.006354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 32/64] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:26.072262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 33/65] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:26.281395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.384598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.394650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da095c-f2b0-46dc-a36f-13b335aa7312 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:26.409333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36cbb-503c-4c78-bbbf-bbceb0a7bf2c None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.409622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36cbb-503c-4c78-bbbf-bbceb0a7bf2c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.409890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36cbb-503c-4c78-bbbf-bbceb0a7bf2c None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.411388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 34/66] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:26.418322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.418611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.418884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.450032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:26.450691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.450974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.451248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.452646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:26.453891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:26.467224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:26.472408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:26.473380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:26.474148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:26.476384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 33/67] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:26.477396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.536942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:26.536942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.633414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.645138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88159b-b966-4fd0-b4d2-1791944482ed None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:26.649262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cce08-9603-4d39-909e-b5c79261eb72 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:26.686019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:26.686645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.686925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.687200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.687882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:26.688187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:26.689762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98b262-8e09-4ba1-b482-8d2685a28909 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:26.695660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:26.697055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.697787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.698263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.699422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 36/69] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:26.700836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4206ac-a468-4cfd-ac23-8c088782b3b0 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.701163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4206ac-a468-4cfd-ac23-8c088782b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.701440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4206ac-a468-4cfd-ac23-8c088782b3b0 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.703246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 37/70] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:26.705313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4206ac-a468-4cfd-ac23-8c088782b3b0 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.715347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-37089695-a2d4-4f91-8370-a53ed897c6dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:26.720514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:26.721758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:26.722775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:26.724851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 34/71] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:26.726231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.726694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.727159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.745859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:26.747383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:26.756934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.816752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 35/72] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:26.817691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.825368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4206ac-a468-4cfd-ac23-8c088782b3b0 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:26.862574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:26.863228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.863519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.863796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.872501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.881269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:26.882739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b5ab-0626-4da1-b6a8-4a8a542163c5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 38/73] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207c34-43db-4689-b00a-8ca3c8f90b65 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207c34-43db-4689-b00a-8ca3c8f90b65 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207c34-43db-4689-b00a-8ca3c8f90b65 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 39/74] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:26.888946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207c34-43db-4689-b00a-8ca3c8f90b65 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.930057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90055946-7c9b-42af-9622-eb6ded465da7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:26.965582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:26.966202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:26.966477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:26.967428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:26.967428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:26.967711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:26.969113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:26.982486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 36/75] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:26.982486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:26.985070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.012047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207c34-43db-4689-b00a-8ca3c8f90b65 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.050716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.051369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.051647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.051919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.062551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-6cd81341-0bc1-4a09-984a-171e6717adfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:27.067779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:27.068676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:27.069491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 40/76] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:27.070134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.070854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.070854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.089663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:27.090926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:27.091068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e66c-eb54-432c-9038-4a11def1473d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.126751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.127386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.127663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.127936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.201712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.203194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.206988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.250765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.267761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 41/77] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:27.268586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.308052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 37/78] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:27.309299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.373793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc3af3-2965-4faa-8391-a8286c490464 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.410806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.411718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.411988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.413139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.414588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.416400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 42/79] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:27.416500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf8a-14c8-4885-be75-93f29aa4ef16 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.419644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.421679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.454104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.454747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.455019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.455290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.455954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:27.456256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.457719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.469044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 38/80] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:27.469044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.484269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.534156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823789a3-371e-4cc4-8a8b-b408a3525013 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.567588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.568220 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.568499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.568771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.570255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba548-6a31-4947-a2d4-dbc355d0a08a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.579007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:27.584464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:27.585387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:27.586157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 43/81] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:27.586807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.604960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.605636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.605936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.606214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.607363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.608834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.610722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 39/82] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:27.611267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.644775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.686025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc18e3-512b-497a-8c5d-35f320aa4e85 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.700143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.712931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538fd47-a4c4-4632-a837-f9de3f7738da None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.721585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.722209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.722493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.722773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.747514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.748166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.748445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.748722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.749918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.751406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.753060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 40/83] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:27.753823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.794243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.795651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.853533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3c9eb-dfff-4e25-b618-6ef695822925 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:27.855353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.889993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:27.890628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:27.890909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:27.891181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:27.891473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 44/84] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:27.892428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.897055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:27.898893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:27.900520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 41/85] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:27.901324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:27.912373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:27.996141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d2bf8-ddf2-4295-8bfe-0173c2edb491 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.001173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd709f3-c007-4882-b948-ca45da93d63f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.028986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.029603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.029884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.030157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.030827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:28.031135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.032536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.034139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.034746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.035020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.035292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.036019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:28.036324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.037785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.040408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 45/86] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.041221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.043269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 42/87] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:27 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.043931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.082509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.139870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.156632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777df88-646d-4672-b425-b764b64d5660 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.167253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571951d4-7fdf-43f7-8c8e-106aaa41857c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.194952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.195617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.195879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.196141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.197300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.198793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.200498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 43/88] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.201352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.220732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.221375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.222048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.222333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.299565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.301233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.306419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f53e-f0e0-4d58-8db6-57a88260fb45 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.308120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.346000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.346524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.346803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.347104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.347729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.349260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.371534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 44/89] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:28 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:28.372388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.395634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.431968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 46/90] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:28.431968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.509826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623ea6-c7be-44ec-bbea-db9f07b0bf34 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.553204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.553864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.554146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.554422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.556742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.557283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.559795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 45/91] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.559795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.564389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535d36-528c-4241-99d0-d548fdaae3e6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.591445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.619990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.621302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.621983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.623211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.626381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=61343595c90645119bdcdf769e315d4c) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:28.626381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.626381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.635233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 47/92] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/role_assignments?user.id=61343595c90645119bdcdf769e315d4c&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.635387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.690683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.705681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcebbf1-d930-476b-9d0f-2774199aeb5c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.749291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.749959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.750239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.750516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.751713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.753362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.755169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 46/93] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.762373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:28.776744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a5a7-63c6-466a-a55b-e1421b684730 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.820880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.821895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.822376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.822867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.867890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:28.875509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad54a-a724-4add-8d5a-9901ea565ad4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:28.898876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.901215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.914819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:28.915705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:28.916409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:28.916827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:28.917793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:28.918473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:28.921030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:28.928727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 47/94] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:28.953500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:29.014133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 48/95] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:29.021138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:29.137836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6033b3d-fdd6-44a3-96bc-c12b28318711 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:29.173819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:29.174475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:29.174758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:29.175036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] PATH_INFO: `/v3/projects/d4cd7766f5054227bae35fada367564b` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:29.176204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] RBAC: Authorizing `identity:get_project(project_id=d4cd7766f5054227bae35fada367564b)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:29.177703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4152e76-fe66-4009-9fd3-f0c03a4c6a59 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:29.179435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 48/96] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:29 2022] GET /identity/v3/projects/d4cd7766f5054227bae35fada367564b => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:29.185397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:29.289140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb1265-d2c7-43f6-ba91-403f3857e10c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:29.324957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:29.325639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:29.325926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:29.326203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:29.326944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=d4cd7766f5054227bae35fada367564b, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:29.327258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:29.328734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487796c7-7e1f-4bbb-95dc-58b941b8c4a3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:29.334643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 49/97] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:29 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=d4cd7766f5054227bae35fada367564b&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:30.502694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56827-acac-49c1-a53a-d332403fa67d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:30.503223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56827-acac-49c1-a53a-d332403fa67d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:30.503223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d56827-acac-49c1-a53a-d332403fa67d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:30.504606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 49/98] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:30.510253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c860b-3f05-483e-a90f-adedc655f4d0 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:30.510714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c860b-3f05-483e-a90f-adedc655f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:30.510791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c860b-3f05-483e-a90f-adedc655f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:30.524183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:30.541959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-cb8c860b-3f05-483e-a90f-adedc655f4d0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:30.543319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cb8c860b-3f05-483e-a90f-adedc655f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:30.629364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 50/99] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:31.158393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d56827-acac-49c1-a53a-d332403fa67d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:31.188009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:31.197900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758781c8-8900-44e8-a212-366d5e5c71a6 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.198508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758781c8-8900-44e8-a212-366d5e5c71a6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.198980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758781c8-8900-44e8-a212-366d5e5c71a6 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.200633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 51/100] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:31.216634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.217315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.217660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.258922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:31.260389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:31.280965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d56827-acac-49c1-a53a-d332403fa67d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:31.346774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:31.347664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.348749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.349178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.368831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7fe11f4a-ca5b-43d9-980a-067202929e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:31.375446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:31.376311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:31.377131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:31.379516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 50/101] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:31.385563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031882f-c373-4a50-915c-8ebae863bd3e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.386034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031882f-c373-4a50-915c-8ebae863bd3e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.386470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031882f-c373-4a50-915c-8ebae863bd3e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.387993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 51/102] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:31.393798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.394293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.394732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.402818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 52/103] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:31.403904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:31.414311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:31.415487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:31.496365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 52/104] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:31.541254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:31.588679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9383-9013-4f05-b4a2-cbc6ddf0ec94 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:31.637681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:31.638323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.638601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.638872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.639564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:31.639868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:31.641311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888da4-72c5-40b6-a069-8f9b990d97d0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:31.650663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 53/105] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:31.656459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:31.674337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:31.735782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e61e-4a24-47c3-a678-9ab15969760b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.736406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e61e-4a24-47c3-a678-9ab15969760b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.736946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e61e-4a24-47c3-a678-9ab15969760b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.738576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 54/106] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:31.743861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.744406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.744880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.775403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540584-8975-400b-bb38-2842fc2307f2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:31.781941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:31.783297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:31.812443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:31.813404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:31.814235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:31.814681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:31.816156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:31.818173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:31.820418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 53/107] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:31 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:31.826529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:31.926852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 55/108] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:31.927655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.013285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.030011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.035214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767a09-d595-4673-910b-7e2f9e0dc76d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.091643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.092084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026f60a-4afb-46c5-bb4a-5021c9259a43 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.092784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.093188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.093559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.095084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.097724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.099535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 54/109] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:31 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:32.100398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.135025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.136218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.136572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.137167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.151845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-4aced745-72c3-4bfc-bf55-462cd38391fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:32.158590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:32.159452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:32.160556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 56/110] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:32.166102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b35bd-b87c-4dd2-b82b-56e5f7332854 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.166837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b35bd-b87c-4dd2-b82b-56e5f7332854 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.167121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b35bd-b87c-4dd2-b82b-56e5f7332854 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.169572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 57/111] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:32.170284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b35bd-b87c-4dd2-b82b-56e5f7332854 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.239450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac011df0-04c6-4902-b32f-6bb4ba87b065 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.287133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.287776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.288047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.288318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.295342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b35bd-b87c-4dd2-b82b-56e5f7332854 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.298497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:32.303186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:32.304030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:32.304823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 55/112] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:32.305493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.313517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.320986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.332541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.333242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.333524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.333797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.335741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, user_id=a8ab08e9e37e4319ac078f0ddc4dab0f, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.337265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4581d4-a16d-419a-96d0-348434d6eb9a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.357010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 58/113] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:32 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:32.357010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.357010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.357010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.372053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:32.373340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:32.426766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ef6f-3e33-4f61-85ce-6595ba0b84f5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.454805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 59/114] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:32.455698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.476362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.477123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.477501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.477866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.478668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:32.479072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.480841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c98989-d308-43b0-9477-4c8ff57e22ed None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.490351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 56/115] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:32.492012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df26cf-db8f-48ea-a812-22ebb6371baa None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.492390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df26cf-db8f-48ea-a812-22ebb6371baa None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.492739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df26cf-db8f-48ea-a812-22ebb6371baa None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.498071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 57/116] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:32.498071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df26cf-db8f-48ea-a812-22ebb6371baa None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.589268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcb1bf-4e16-427f-9955-f692b4562c18 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.598422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.613685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.630470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.631402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.631910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.632360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.633689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.635503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.637375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 60/117] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:32.638349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.646585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df26cf-db8f-48ea-a812-22ebb6371baa None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.687608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501ba38-247f-4144-835a-12710197374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.689168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ba38-247f-4144-835a-12710197374b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.689702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ba38-247f-4144-835a-12710197374b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.690169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501ba38-247f-4144-835a-12710197374b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.691167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501ba38-247f-4144-835a-12710197374b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:32.692017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501ba38-247f-4144-835a-12710197374b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.694052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501ba38-247f-4144-835a-12710197374b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.704243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 58/118] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:32.706098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.706630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.707095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.726924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:32.729308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:32.753448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1d54-0c2e-45b7-9ef7-06f249a9ae2a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.796381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.797062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.797345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.797621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] PATH_INFO: `/v3/users/b90985777b4d484094fa875c0be85803` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.808941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 59/119] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:32.808941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.819846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] RBAC: Authorizing `identity:get_user(user_id=b90985777b4d484094fa875c0be85803)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.821379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:32.823084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 61/120] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/users/b90985777b4d484094fa875c0be85803 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:32.823859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:32.870955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.879246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:32.928200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca260-7d97-4dc9-a957-702ab01e6af9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.973406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a627-1760-4b33-b438-b36e55ef3198 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:32.979713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:32.980707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:32.981202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:32.981671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:32.982569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:32.984757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.019589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.020240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.020523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.020800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.022326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.024152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.025783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 62/121] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:32 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.027198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 60/122] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:31:32 2022] POST /identity/v3/projects => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:33.028400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.031456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.153983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4813c1-bc65-4910-94f5-e533b6276a5d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.174315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.179096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.180330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460421-79a8-4d81-a37e-905b8797df14 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.197933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.198920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.198920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.199268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.233789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.234451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.234725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.234992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.252842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:33.257603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:33.258641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:33.259450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 63/123] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:33.260112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.289838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.292539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.405934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e01f45-14c4-44cf-b920-9cf9476b1a12 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.412599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 61/124] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:33.414768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.445090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.448742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.449768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.450532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.451029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.452422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.454168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.456068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 64/125] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.457078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.488668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.551154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0053b9-b231-4f55-876d-f8a3c1742f55 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.566730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac93122-2813-4d32-aaae-642569a8fa0b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.592695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.593840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.594285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.594895 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.603162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.603975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.604354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.604724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.605599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:33.606003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.607493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.608208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:33.614765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:33.615818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:33.616803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:33.618750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 62/126] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:33.619653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.623714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 65/127] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.624959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.718717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.729375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.730641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c977-8999-42c9-866c-5565c454e50e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.759820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618ea43-501c-438a-a5fb-17c4dffe1f78 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.768624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.769909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.769909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.770274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/61343595c90645119bdcdf769e315d4c/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.772428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, user_id=61343595c90645119bdcdf769e315d4c, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.774385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.792531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 66/128] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:33 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/61343595c90645119bdcdf769e315d4c/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:33.793937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.803153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.804166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.804685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.805135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.806557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.808430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.810775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 63/129] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.811957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.912130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f5474-032c-41e3-b57f-1162175d3dd3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.930000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd209-5b3d-4c0f-9cc9-89da06959b9a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:33.948970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.949684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.949970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.950250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.951528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.953117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.954756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 67/130] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.955546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:33.972661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:33.973776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:33.974268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:33.974764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:33.975632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:33.976225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:33.978049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:33.980648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.989041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 64/131] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:33.990304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:34.002705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:34.067420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c392c0-7076-418b-9ea9-c2acca96c7aa None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.101655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510f2df-e261-462b-8979-0537611bc79f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.105157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.105157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.105534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.105776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.106521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=b90985777b4d484094fa875c0be85803) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:34.106831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.108296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.114227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 68/132] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/role_assignments?user.id=b90985777b4d484094fa875c0be85803&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=697ae27283084dfab686c35a840eb508 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:34.115073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:34.145396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.146420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.147082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.147547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.149407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.151544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.154105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 65/133] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:33 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:34.161653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:34.233434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:34.254264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503b529-e2ee-433c-9f81-83745b32a1e7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.311627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.312293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.312571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.312848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.314739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.316217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.317917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 69/134] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:34 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:34.326182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:34.379778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:34.411181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea727a-9592-49c2-9a12-39fce9d56597 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.480390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c1abc-6d39-4ac3-a5ad-a4b28a7b3f23 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.482969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.483664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.483946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.484222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.492057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, user_id=a8ab08e9e37e4319ac078f0ddc4dab0f, role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.493571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ffd7c-5427-40fe-9b43-16bbb7d4adf6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.515501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 66/135] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:34 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:34.518045 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070167-6e83-4894-83eb-fa463e66fbbd None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.518330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070167-6e83-4894-83eb-fa463e66fbbd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.518604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da070167-6e83-4894-83eb-fa463e66fbbd None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.519917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 67/136] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:34.527177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.528834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.529526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.529799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.530066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] PATH_INFO: `/v3/projects/d4cd7766f5054227bae35fada367564b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.530649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.530980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.531770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] RBAC: Authorizing `identity:get_project(project_id=d4cd7766f5054227bae35fada367564b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.533433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.535275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 70/137] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:34 2022] GET /identity/v3/projects/d4cd7766f5054227bae35fada367564b => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:34.544488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:34.578347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:34.582347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:34.587441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:34.682559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 68/138] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:34.714574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10011597-eec4-44aa-8dfb-effb3f569f7b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:34.751590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:34.752699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:34.753302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:34.753801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] PATH_INFO: `/v3/projects/d4cd7766f5054227bae35fada367564b/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:34.756157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4cd7766f5054227bae35fada367564b, user_id=a8ab08e9e37e4319ac078f0ddc4dab0f, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:34.757919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:34.785043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 71/139] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:34 2022] PUT /identity/v3/projects/d4cd7766f5054227bae35fada367564b/users/a8ab08e9e37e4319ac078f0ddc4dab0f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:35.026286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:35.093886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:35.131368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277325e0-2dc4-42f6-b8de-3b24e9b4dd35 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:35.178559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:35.179221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.179496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.179763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.195384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:35.200282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:35.201160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:35.202319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 69/140] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:35.209214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:35.306629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:35.328827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fd92b-fcee-4052-ad8c-03ed77dfa536 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:35.363782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:35.364412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.364694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.365046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.365733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:35.366085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:35.367491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6b993-f892-4ec2-a54f-8691cddbb3a2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:35.376510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 72/141] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:35.381946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:35.459823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ab5-f086-4beb-83d4-8f076b2aafa8 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.460146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ab5-f086-4beb-83d4-8f076b2aafa8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.460390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff22ab5-f086-4beb-83d4-8f076b2aafa8 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.461955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 73/142] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:35.474797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.475078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.475364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.505582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:35.506975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:35.573918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c24f-877c-4cff-98bf-ae8152aff863 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:35.623481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:35.637771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:35.638458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.638792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.639077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.640313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:35.642082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:35.643763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 70/143] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:35 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:35.652014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:35.653131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 74/144] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:35.808818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2d0e-b781-4264-95b9-9700375c09b6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:35.852477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:35.853053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:35.853382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:35.853657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:35.927826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:35.939733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:35.941313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:36.049537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 71/145] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:36.054915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:36.147377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:36.154671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:36.190189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997e2a-a96f-425e-ad98-0758260b3b39 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:36.238684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:36.239365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:36.239644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:36.239923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:36.241099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:36.242802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:36.245407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 75/146] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:36 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:36.252948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:36.365853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a6b80-7bd3-4549-a521-780c8dce4885 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:36.397896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:36.406658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f8ffa-bd51-4a72-a881-f7c41a05492f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:36.419801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:36.420422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:36.420703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:36.424929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:36.424929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:36.424929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:36.424929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:36.430534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 76/147] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:36 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:36.482947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:36.483615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:36.483895 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:36.484161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:36.488959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:36.490574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474b12-5f41-473e-9576-3c89db536194 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:36.492625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 72/148] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:36.498285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:36.507616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:36.628359 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe63795-469d-43d4-9a45-f7000addfd26 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:36.664666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:36.665241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:36.665520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:36.665794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:36.666463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:36.668030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd495b-be24-4dac-bae2-8adc976960bf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:36.703370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 77/149] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:36 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:37.035977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7d55-30fd-41f0-a78c-32acaabbd6c6 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.036378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7d55-30fd-41f0-a78c-32acaabbd6c6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.036550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7d55-30fd-41f0-a78c-32acaabbd6c6 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.037918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 73/150] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:37.043421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.043964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.044448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.067012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:37.069028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:37.131269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec20e-5c07-479b-bbbd-f604190cf32c None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.131780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec20e-5c07-479b-bbbd-f604190cf32c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.131885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec20e-5c07-479b-bbbd-f604190cf32c None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.133205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 74/151] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:37.136023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:37.140012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.140295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.140588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.157762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 78/152] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:37.163051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:37.164261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:37.243174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 75/153] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:37.459446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:37.513224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:37.571230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2aa46-961b-41f1-b5d2-21bee0c56cf7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:37.612087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:37.612849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.613159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.613617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.625405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:37.629640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-7f2f0b23-35a5-4d1b-be3d-9c3fd6d54e88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:37.631670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:37.634252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:37.635267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 79/154] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:37.642956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbc0e-5a5e-4734-a793-baac2124b1e0 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.643239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbc0e-5a5e-4734-a793-baac2124b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.643514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbc0e-5a5e-4734-a793-baac2124b1e0 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.645069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 80/155] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:37.645671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bbc0e-5a5e-4734-a793-baac2124b1e0 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:37.647898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b70ce-26fc-46f0-b90d-3b38592b165c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:37.701270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:37.701471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.701692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.701952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.715083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:37.719184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f6cb23e7-0b8a-45e1-8f4a-ce64a3331987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:37.720098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:37.720993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:37.722438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 76/156] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:31:37.723611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c1d4-6ab9-4921-bdf0-22000636c50b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.723889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c1d4-6ab9-4921-bdf0-22000636c50b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.724154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c1d4-6ab9-4921-bdf0-22000636c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.749077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-daa2c1d4-6ab9-4921-bdf0-22000636c50b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:37.750647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-daa2c1d4-6ab9-4921-bdf0-22000636c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:37.789230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bbc0e-5a5e-4734-a793-baac2124b1e0 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:37.827368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:37.828005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.828283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.828553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.830559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 77/157] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:37.830670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] RBAC: Adding query filter params (name=reader) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:37.830670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:37.830817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4995-f720-4acd-b096-479412c4820e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.830817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4995-f720-4acd-b096-479412c4820e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.831050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4995-f720-4acd-b096-479412c4820e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.831203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13633117-6dc3-44a7-bc9d-5dff9d5c6bea None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:37.832714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 78/158] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:37.833336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4995-f720-4acd-b096-479412c4820e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:37.852427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 81/159] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:37.853739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.854017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.854354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.888855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:37.890193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:37.926427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:37.949604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4995-f720-4acd-b096-479412c4820e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:37.990236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:37.991840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:37.993822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:37.994248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:37.995111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:37.995774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:37.998302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.018181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 79/160] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:38.019271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.041228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 82/161] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:38.042465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.123793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:38.214145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345da4-2c48-4345-8e90-56299596be10 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.230964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123a06c-aad7-49ba-b8eb-2d84260eee68 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.248535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.249148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.249429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.249705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] PATH_INFO: `/v3/users/b90985777b4d484094fa875c0be85803` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.250909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b90985777b4d484094fa875c0be85803)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:38.252412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.254246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 80/162] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/users/b90985777b4d484094fa875c0be85803 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:38.254834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.273687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.274742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.275158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.275632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] PATH_INFO: `/v3/users/61343595c90645119bdcdf769e315d4c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.276217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:38.278473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] RBAC: Authorizing `identity:get_user(user_id=61343595c90645119bdcdf769e315d4c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:38.280119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.282005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 83/163] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/users/61343595c90645119bdcdf769e315d4c => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:38.283695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.371488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa945a8d-2bef-491c-b940-aa64902d79c8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.408766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.411424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.411424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.411424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.420825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:38.426104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:38.427182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 81/164] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:38.428088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.463811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa82fd7-70bc-4ca9-ac38-be64e262f21e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.485281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:38.522892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:38.542554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.543235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.543511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.543812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.544957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:38.546446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.548097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 84/165] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:38.555797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0e8c-7d88-43b4-bde9-a78205782af7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.557994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.599724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.600351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.600627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.600915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.672133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:38.673487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.726297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279605a4-cdf2-4e49-874d-dc4b5e80a8ed None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:38.791501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:38.796306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:38.796941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:38.799749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:38.799749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:38.799749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:38.799749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:38.800517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:38.813487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 85/166] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:38.813487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.852207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 82/167] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:38.853411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:38.892013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:39.002568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca5617-0a80-4dbe-8a24-3a914656f79e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.035207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97f66b-aadb-47d5-8223-a5e898965b75 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.065899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.066911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.067406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.067873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/b90985777b4d484094fa875c0be85803/roles/697ae27283084dfab686c35a840eb508` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.070441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, user_id=b90985777b4d484094fa875c0be85803, role_id=697ae27283084dfab686c35a840eb508)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:39.073147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:39.093799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 86/168] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:38 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/users/b90985777b4d484094fa875c0be85803/roles/697ae27283084dfab686c35a840eb508 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:39.095420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.097729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.098654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.100885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.101436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.125518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:39.136684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:39.137790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:39.138589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:39.144131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 83/169] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:39.145329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.231867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:39.318632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:39.324614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad2605-ba30-466f-8f3d-270bc6261e82 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.355676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cecb9-405d-48e3-9f8a-41fd7e153281 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.404130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.405537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.405823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.406092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.407854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:39.409323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:39.410906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 87/170] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:39.413191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.421724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.422412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.422687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.422949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.425874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:39.427348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:39.429067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 84/171] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:39.433409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.593655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25762e6-fe3e-458e-b5a9-5b879107cfc2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.597590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:39.602581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b598-6f43-4067-af52-c3d789dffa9f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.650718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.651353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.651634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.651908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.680115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:39.680795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:39.681100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:39.681368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:39.682160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:39.682328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:39.683858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:39.705970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 88/172] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:39.706909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.730562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:39.733170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:39.753196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:39.912429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 85/173] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:39.913407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:39.932751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f206c-8086-4805-b207-fa5057c6efc2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:39.933013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.027279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94284-8248-491b-92fe-0612d108fb68 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:40.054267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:40.054887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.056270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.056563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.057353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=61343595c90645119bdcdf769e315d4c) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:40.057662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:40.059172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:40.075334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 89/174] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/role_assignments?user.id=61343595c90645119bdcdf769e315d4c&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:40.077388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:40.113159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:40.114443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.116062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.116348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] PATH_INFO: `/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.118608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] RBAC: Authorizing `identity:get_user(user_id=a8ab08e9e37e4319ac078f0ddc4dab0f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:40.120102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44e58f-30a2-474b-b700-1006fe7113ac None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:40.121986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 86/175] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:39 2022] GET /identity/v3/users/a8ab08e9e37e4319ac078f0ddc4dab0f => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:40.126971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b401-1389-4482-a0a5-e004b752bb6d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.127311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b401-1389-4482-a0a5-e004b752bb6d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.127613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b401-1389-4482-a0a5-e004b752bb6d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.130976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 87/176] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:40.133231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b401-1389-4482-a0a5-e004b752bb6d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:40.328391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.342367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.368158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744eba2-764e-4879-805e-8201b8158552 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:40.382126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b401-1389-4482-a0a5-e004b752bb6d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:40.440926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:40.440926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.440926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.440926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.462206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:40.462867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.463173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.463404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] PATH_INFO: `/v3/projects/d4cd7766f5054227bae35fada367564b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.465730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] RBAC: Authorizing `identity:get_project(project_id=d4cd7766f5054227bae35fada367564b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:40.468920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee01d49-b09a-4fe7-88ce-2bc22148236e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:40.470560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 90/177] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:40 2022] GET /identity/v3/projects/d4cd7766f5054227bae35fada367564b => generated 312 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:40.472787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951421a-6463-40df-b707-01e2ad9f3377 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.472787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951421a-6463-40df-b707-01e2ad9f3377 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.472787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951421a-6463-40df-b707-01e2ad9f3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.512942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a951421a-6463-40df-b707-01e2ad9f3377 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:40.512942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a951421a-6463-40df-b707-01e2ad9f3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:40.549304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:40.550791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221b3cb-17a8-4eee-be43-a37a9c14a2ec None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:40.623228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 91/178] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:40.625160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb641-b6a6-465d-9414-0270ac08558e None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.625647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb641-b6a6-465d-9414-0270ac08558e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.626099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb641-b6a6-465d-9414-0270ac08558e None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.632921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 92/179] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:40.633485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.634280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb641-b6a6-465d-9414-0270ac08558e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:40.674838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 88/180] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:40.676200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed645-041b-4e77-9f36-06350396fe48 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.676480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed645-041b-4e77-9f36-06350396fe48 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.676747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed645-041b-4e77-9f36-06350396fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.696241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c87ed645-041b-4e77-9f36-06350396fe48 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:40.697447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c87ed645-041b-4e77-9f36-06350396fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:40.740404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.755124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb641-b6a6-465d-9414-0270ac08558e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:40.767221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 89/181] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:40.768806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71a67-47f8-4727-9573-e4271ff251e6 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.773184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71a67-47f8-4727-9573-e4271ff251e6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.773184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71a67-47f8-4727-9573-e4271ff251e6 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.773184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 90/182] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:40.773184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71a67-47f8-4727-9573-e4271ff251e6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:40.820729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:40.821362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.821633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.821905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.822620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=d4cd7766f5054227bae35fada367564b, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:40.822921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:40.824440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521580-fc47-4f1a-9e37-ba61d919b28c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:40.831921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 93/183] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:40 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=d4cd7766f5054227bae35fada367564b&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:40.836966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:40.836966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:40.836966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:40.870684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:40.871946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:40.952972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:40.968694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71a67-47f8-4727-9573-e4271ff251e6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.010306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 94/184] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:41.014084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.048842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.049507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.049778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.050043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.051291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.053769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.061031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 91/185] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:40 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:41.066744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.136100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.156444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f46b3-c7b2-4114-97cc-a8343f5c2dc4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.213933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78c09-73ba-488e-9114-de7b60a6c70f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.221299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.222088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.222297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.222563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.235358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:41.240251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:41.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:41.242059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 95/186] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:41.242746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.250761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.251379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.251657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.251929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.252688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=a8ab08e9e37e4319ac078f0ddc4dab0f) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:41.253516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.255489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.265371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 92/187] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/role_assignments?user.id=a8ab08e9e37e4319ac078f0ddc4dab0f&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:41.266031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.323553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.420250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629522fe-1771-49f7-b971-d7f1da3e0caf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.431997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2983b7-da3d-48b9-baa8-e6e7835a1212 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.459265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.459896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.460173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.460445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.461266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:41.461569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.463480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.472453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 93/188] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:41.473346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.474515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.475361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.475816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.476454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.489964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:41.495563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:41.496574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 96/189] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:41.497455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.506491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.592455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.602390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31e46f-29f5-468b-9826-3ae8aeaebccd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.638489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6820713-440c-49e8-a8b0-4558078b01b4 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.642262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.642909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.643186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.643460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.644644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.646586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.653288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 94/190] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:41.653288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.674650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.675328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.675608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.675875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.692729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.694526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.696775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 97/191] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:41.697078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.764021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.773074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0f77d-2142-46d1-a196-47bbc64281f5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.805756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6b44-4310-4b84-bcc2-9185f075d7ca None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:41.812018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.812640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.812912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.813629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.813983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:41.814340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.815846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.829059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 95/192] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:41.829059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.851647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:41.852198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:41.852447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:41.852714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:41.853484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:41.855480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:41.856474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:41.885051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 98/193] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:41 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:41.885051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:41.974578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87aa3-8904-4e34-b266-2008b4e09f38 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.015252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.015863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.016138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.016470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.027024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6f39d-6723-44c4-9ba7-a70990da68ad None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.047084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.068198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.068842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.069160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.069430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.070810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.072010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d869f6-8a2a-43c1-bb0c-5e3e70f83079 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.073667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 99/194] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:42.074960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb06e-abbd-4150-907c-cf84aa75dd66 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.075234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb06e-abbd-4150-907c-cf84aa75dd66 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.075503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eb06e-abbd-4150-907c-cf84aa75dd66 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.076697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 100/195] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:42.081640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eb06e-abbd-4150-907c-cf84aa75dd66 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.096481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.098431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003d88d-5645-414a-8619-97a7c174f114 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.126736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.206110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eb06e-abbd-4150-907c-cf84aa75dd66 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.228053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 96/196] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:42.230540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.230540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.230540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.248727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:42.250101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:42.250314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.251072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.251354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.251625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.320685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 97/197] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:42.321957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.327458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.328960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.346936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.378037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.426470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f139c-4ffb-4354-b6aa-36f3d1cf6dc7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.438585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 101/198] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:42.444505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.465504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.466492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.466966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.467431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.468866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.470627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.472836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 98/199] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:42.478794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.541290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.549893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e4b0-a2aa-4197-8c4a-8dabdbb91059 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.582025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f797bc-58e5-41ae-aa5b-6fd6960af42b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.586298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.587048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.587423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.587847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.589150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.590762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.592983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 102/200] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:42.598753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.606562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:42.621517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.622366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.622785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.623196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.624201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=92fc31babd1942d3bbe8df569ab52a1a) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:42.624721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.626396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.632230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 99/201] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/role_assignments?user.id=92fc31babd1942d3bbe8df569ab52a1a&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:42.752499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:42.766500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50a583-6031-421e-b97e-983a07eb37af None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.822413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.823432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.824198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.825609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.826558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=92fc31babd1942d3bbe8df569ab52a1a) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:42.827086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:42.828743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:42.839228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 103/202] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/role_assignments?user.id=92fc31babd1942d3bbe8df569ab52a1a&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:42.920170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f098c2-3db2-4cf5-8262-2d994ef9e4a9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:42.962489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:42.963153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:42.963426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:42.963695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:42.984179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:42.992040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:42.993012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:42.993838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 100/203] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:31:42.999374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:43.026424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:43.114207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0cf7e-e572-44ae-b6ec-723672efb7c6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:43.166641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:43.167259 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:43.167533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:43.167855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:43.168522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:43.168825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:43.170367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:43.180249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 104/204] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:43.186017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:43.267300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:43.341274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923691-fcb6-42f2-9729-497c8025216b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:43.384444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:43.385121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:43.385408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:43.385675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] PATH_INFO: `/v3/users/b90985777b4d484094fa875c0be85803` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:43.386878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] RBAC: Authorizing `identity:get_user(user_id=b90985777b4d484094fa875c0be85803)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:43.388355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:43.389995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 101/205] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:43 2022] GET /identity/v3/users/b90985777b4d484094fa875c0be85803 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:43.396011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:43.527651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:43.553587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9977b3a-9992-47a8-af6f-a6bb3d1c093b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:43.601196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:43.602194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:43.602665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:43.603139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:43.682314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:43.684219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:43.766638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:43.789254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 105/206] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:43.796941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:43.942661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4fcd-ba15-4417-a6ec-4426fb210594 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:43.965276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:43.988357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:43.989029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:43.989308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:43.989580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:43.990734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:43.992186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f3d6a-9583-4bea-b49f-1722a1735076 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:43.994188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 102/207] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:43 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:44.000354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:44.123628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e67-bbee-485c-b135-8d6734fd0540 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.123815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e67-bbee-485c-b135-8d6734fd0540 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.124079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b2e67-bbee-485c-b135-8d6734fd0540 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.125605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 103/208] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:44.152263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f867e1a-1a26-4ab4-8334-89e4789fb1e9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:44.161640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8017c-a5d1-412d-998b-80a0cdf320f6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.161916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8017c-a5d1-412d-998b-80a0cdf320f6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.162190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8017c-a5d1-412d-998b-80a0cdf320f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.195922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-36b8017c-a5d1-412d-998b-80a0cdf320f6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:44.197136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-36b8017c-a5d1-412d-998b-80a0cdf320f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:44.204441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:44.205127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.205422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.205679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.206512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc, user.id=b90985777b4d484094fa875c0be85803) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:44.206824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:44.208272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfba3c7-8ae2-4e17-9959-4737271dab6a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:44.214820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 106/209] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:43 2022] GET /identity/v3/role_assignments?user.id=b90985777b4d484094fa875c0be85803&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=697ae27283084dfab686c35a840eb508 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:44.313436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 104/210] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:44.512218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b091a-7a42-4759-b562-b3053bbca231 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.512558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b091a-7a42-4759-b562-b3053bbca231 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.512764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b091a-7a42-4759-b562-b3053bbca231 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.514165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 107/211] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:44.519626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.519906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.520176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.540546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:44.541752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:44.621800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 105/212] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:44.675364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b091a-7a42-4759-b562-b3053bbca231 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:44.731111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:44.788925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b091a-7a42-4759-b562-b3053bbca231 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:44.823654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:44.824338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.824614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.824878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.836589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:44.841330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:44.842212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:44.843012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:44.847261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 108/213] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:44.848626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:44.890744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:44.920184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:44.954277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98f45-c24f-4aa6-9b82-1791bc67318a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:44.989009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:44.989622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:44.989900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:44.990161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:44.990826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:44.991117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:44.992490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84f18-62bd-41bf-981f-16ed30806d1a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.001490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 106/214] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:45.002501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4c47-7d7a-4ddf-bb13-51eac8dfb900 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.002777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4c47-7d7a-4ddf-bb13-51eac8dfb900 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.003040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b4c47-7d7a-4ddf-bb13-51eac8dfb900 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.004341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 107/215] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:45.009125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b4c47-7d7a-4ddf-bb13-51eac8dfb900 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.029559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33d995-6df5-48a7-957d-e1891aa56219 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.032988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.067876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.068412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.068702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.068970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.070242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.071732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71456a-c5d0-4563-92f2-1e9dd6aad293 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.073452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 109/216] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:45.074419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.074695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.074962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.092945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:45.094132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:45.123476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b4c47-7d7a-4ddf-bb13-51eac8dfb900 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.125342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.164175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.164809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.173079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 110/217] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:45.173233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.173233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] PATH_INFO: `/v3/users/153ab4de04484ceeaed845beb8ef15fc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.173482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.188694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] RBAC: Authorizing `identity:get_user(user_id=153ab4de04484ceeaed845beb8ef15fc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.190472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.192561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 108/218] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/users/153ab4de04484ceeaed845beb8ef15fc => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:45.198341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.287747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828591-ec94-408f-9999-5da2fd3b41ea None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.289414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.319384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867edc9-58ff-40a1-8a25-5e0dbd03a31c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.326401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.327451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.327742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.328017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.328673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.330875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293116e-bdf3-4bf2-b941-514075c98ffd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.352839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 111/219] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:45 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:45.352839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca03d-0607-4e50-b9cf-34b386c849dd None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.352839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca03d-0607-4e50-b9cf-34b386c849dd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.352839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca03d-0607-4e50-b9cf-34b386c849dd None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.360755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 112/220] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:45.362617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.363000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.363401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.364647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.365518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.365964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.366376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.390809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:45.393064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:45.408135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.463181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.464995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.479997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 113/221] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:45.480766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.580998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.595646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1002558-c230-4c9a-a170-3f7bdf567219 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.599137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 109/222] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:45.604459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.641301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.642143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.642268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.642467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.660421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:45.665813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:45.666876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:45.667728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 114/223] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:45.676304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.686528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.737316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520609e4-a9e9-4d47-93a0-f1471a2b32b0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.776102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.776805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.777167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.777436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.778965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.780794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.783069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 110/224] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:45.783970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.814761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3acb-c79c-43cd-a514-bf5f49c2f9dc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.853835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.854811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.854811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.855118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.855728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:45.856025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:45.857510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:45.868236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 115/225] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:45.870041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:45.889289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.917839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152edd0b-45dc-4334-b1c6-433a89b24df9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.955478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:45.965652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:45.966873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:45.967377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:45.968079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:45.983193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:45.987745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30895c-d4fb-4598-9ace-9d0cc222f1a6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:45.989960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:45.990858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:45.991715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:45.994324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 111/226] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:45.997752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.028871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.029506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.029781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.030136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.030788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=153ab4de04484ceeaed845beb8ef15fc) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:46.031092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.032637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.038658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 116/227] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/role_assignments?user.id=153ab4de04484ceeaed845beb8ef15fc&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:46.045179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.181957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591126-c8d0-465d-82de-3b81a5056ebe None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.195148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:46.235504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.236550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.238074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.238554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.244843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.245324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.247159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 112/228] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:45 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:46.252745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.259554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca972-dd23-4e11-aea6-13d520ce0f1c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.307787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.308829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.310546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.311778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.313756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:46.315542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.317200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.337001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 117/229] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:46.340366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:46.342911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.433093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed8007-dce7-4569-81bc-0e7af446afdf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.512874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.513586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.513874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.514137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.515273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.516735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.518446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 113/230] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:46 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:46.524452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.532050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72f850-607d-4a1d-a408-8d7c9ad5dd65 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.576436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.577569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.578062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.578538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.580649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.582338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.585720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 118/231] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:46 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:46.592994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.595966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:46.672783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfbf9f-6152-4b53-bf77-2a46a8f061a0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.701394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:46.713795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.714813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.715281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.715729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/92fc31babd1942d3bbe8df569ab52a1a/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.718346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, user_id=92fc31babd1942d3bbe8df569ab52a1a, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.720016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.744392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 114/232] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:46 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/92fc31babd1942d3bbe8df569ab52a1a/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:46.790448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406ece-8fb4-4f0c-8be6-32e371a89909 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:46.828803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:46.829794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:46.830289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:46.830748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:46.832184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:46.833988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00b9f-749e-4828-949a-26d92f84699f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:46.835881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 119/233] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:46 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:46.842141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:46.979648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55ca64-d5f4-4cea-a118-14301bc0916f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:47.017124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:47.017800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:47.018080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:47.018352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/92fc31babd1942d3bbe8df569ab52a1a/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:47.020547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, user_id=92fc31babd1942d3bbe8df569ab52a1a, role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:47.022073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0be15-db53-4158-8e0c-be642ad05f67 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:47.039839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 115/234] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:46 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/92fc31babd1942d3bbe8df569ab52a1a/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:47.723010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fe92-8a1b-462b-84a1-da703fe3fe81 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:47.723753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fe92-8a1b-462b-84a1-da703fe3fe81 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:47.724306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181fe92-8a1b-462b-84a1-da703fe3fe81 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:47.725924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 120/235] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:47.731384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a18b-9fcd-41af-8b02-3199c4956d73 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:47.731903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a18b-9fcd-41af-8b02-3199c4956d73 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:47.732396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a18b-9fcd-41af-8b02-3199c4956d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:47.757900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a161a18b-9fcd-41af-8b02-3199c4956d73 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:47.759441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a161a18b-9fcd-41af-8b02-3199c4956d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:47.806071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:47.852414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 116/236] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:47.939447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413ab6-228a-4a22-b9f5-0a1239f35bd1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:47.939989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413ab6-228a-4a22-b9f5-0a1239f35bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:47.939989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f413ab6-228a-4a22-b9f5-0a1239f35bd1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:47.941405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 121/237] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:47.954493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:47.954800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:47.955046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:47.981948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:47.983085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:48.051998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 117/238] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:48.233742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f413ab6-228a-4a22-b9f5-0a1239f35bd1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.327267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:48.363781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f413ab6-228a-4a22-b9f5-0a1239f35bd1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.412627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:48.413304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.413583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.413854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.433348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:48.438200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:48.439088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:48.439889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 122/239] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:48.446810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.524709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.565034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41694028-f042-400d-a9a7-8c8dac4b6d53 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.568491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:48.603559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:48.604314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.604653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.605059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.605795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:48.606178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:48.607654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc164b4-68a0-49db-abaa-1270ee93579b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:48.616562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 118/240] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:48.618032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35831f2-a811-4b16-a697-143405fda861 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.618380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35831f2-a811-4b16-a697-143405fda861 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.618716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35831f2-a811-4b16-a697-143405fda861 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.619976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 119/241] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:48.624941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35831f2-a811-4b16-a697-143405fda861 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.658050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df769071-5f53-4c3d-ab37-52be029ffc35 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.695951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:48.703018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:48.703673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.703948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.704218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.705915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:48.707419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4294a-f1eb-4ff4-9940-06640b23571c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:48.709763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 123/242] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:48.711215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.711498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.711773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.731829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:48.732994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35831f2-a811-4b16-a697-143405fda861 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.733286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:48.770152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:48.770892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.771226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.771556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] PATH_INFO: `/v3/users/8885ea7c8459413bae27be46c2c6be08` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.786667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] RBAC: Authorizing `identity:get_user(user_id=8885ea7c8459413bae27be46c2c6be08)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:48.788203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:48.790035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 120/243] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:48 2022] GET /identity/v3/users/8885ea7c8459413bae27be46c2c6be08 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:48.790912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.804130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 124/244] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:48.805068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:48.830943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:48.909156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f55ec-65c8-4b15-b332-44e747a3062d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.922898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9694f-b626-4368-82c5-4808d3ae5289 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:48.948555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:48.960310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:48.960950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:48.961392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:48.961807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:48.999427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.000689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.001136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.001555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.002376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.005548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7655c1-5f17-4dae-9c8f-cb7bcc3d04c5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.044498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 121/245] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:48 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:49.047054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69d75-c20c-4102-945c-015938c409cc None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.047826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69d75-c20c-4102-945c-015938c409cc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.048348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69d75-c20c-4102-945c-015938c409cc None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.051321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 122/246] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:49.057129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.057778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.058962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.060481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.062038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.084288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:49.086656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:49.170239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 123/247] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:49.170970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.184929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.198679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 125/248] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:49.206009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.266089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.286665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d530b8d-c065-4f5a-aba7-08b5fb4c1335 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.322119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.322731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.323004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.323267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.336146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:49.342054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:49.342958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:49.343752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 124/249] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:49.349336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.353910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a0fee-7fea-4baf-897d-b30701c02a82 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.393982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.394895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.397163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.397642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.399346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.401004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.403227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 126/250] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:49.409830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.445897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.489984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3c9d-736b-41fe-a028-ea7a22c3c961 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.536447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.536648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.537061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.537330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.537586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.538361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:49.538702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.540803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397487-831a-4bab-afda-cb0136224d52 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.541205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f5b2-5cc9-4dee-883d-69ace183a4ae None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.552152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 125/251] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:49.554158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ba261-8c85-45a8-a0f3-f13c09c8db4b None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.554451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ba261-8c85-45a8-a0f3-f13c09c8db4b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.554720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ba261-8c85-45a8-a0f3-f13c09c8db4b None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.556439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 126/252] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:49.557168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ba261-8c85-45a8-a0f3-f13c09c8db4b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.583936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.584541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.584723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.585828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.585828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=8885ea7c8459413bae27be46c2c6be08) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:49.586058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.587512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.594575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 127/253] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/role_assignments?user.id=8885ea7c8459413bae27be46c2c6be08&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=697ae27283084dfab686c35a840eb508 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:49.595206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.718163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ba261-8c85-45a8-a0f3-f13c09c8db4b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.784117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.787805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c733562-b650-437a-8dcb-905aee74d2bb None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:49.799084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.800529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.801406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.801878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.821333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-a98e70e4-6756-42b3-8597-cbffbd548627 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:49.826694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:49.827589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:31:49.828393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:49.831654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 127/254] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:49.833258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.833728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.834247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.855049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:49.856576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:49.858188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:49.858849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:49.859120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:49.859558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] PATH_INFO: `/v3/users/153ab4de04484ceeaed845beb8ef15fc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:49.865593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=153ab4de04484ceeaed845beb8ef15fc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:49.868920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:49.873786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 128/255] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/users/153ab4de04484ceeaed845beb8ef15fc => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:49.875210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:49.940144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.988892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 128/256] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:49.989853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.049988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354edb26-650f-4475-9d57-aa25b9495dd0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.103107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16afb0-e887-4a4b-90fc-68d4fba55769 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.105456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.106322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.106786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.107656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.108527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:50.109100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:50.110710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:50.127938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 129/257] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:50.130211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:50.143655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.150498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.151154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.151433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.151704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.153664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:50.155193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:50.161284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 129/258] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:49 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:50.162447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.340017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:50.352749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a7be-1261-4f27-96f8-c2fe6fb5a7c1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.358883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f72ec-22fe-4423-b09c-d780a97e1487 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.420040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.420723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.421026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.421301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/153ab4de04484ceeaed845beb8ef15fc/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.424952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.425601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.425875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.426148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.427879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, user_id=153ab4de04484ceeaed845beb8ef15fc, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:50.429389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:50.432017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:50.433519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:50.435355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 130/259] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:50 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:50.435889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.455405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 130/260] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:50 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/153ab4de04484ceeaed845beb8ef15fc/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:31:50.456549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.568993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:50.654407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb899956-8da2-49cf-b146-40dfc7768fd9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.669677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b7dc-4490-4dfd-b28d-0864d7ac2335 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.724830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.725484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.725761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.726031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.741418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:50.742041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:50.742313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:50.742578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:50.750284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:50.760138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:50.761050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:50.762557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 131/261] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:31:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:50.772183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:50.811345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:50.883295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:50.884800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:50.947989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6507b-db05-45b0-86b0-9ce0861002d7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:50.970315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:51.025064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 131/262] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:51.029131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:51.030409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:51.033382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:51.033668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:51.034006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:51.034700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:51.035052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:51.036477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:51.057956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 132/263] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:31:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:51.065915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:51.130029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16fe18-922c-45b3-82dc-043763f74280 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:51.165049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:51.165701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:51.166007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:51.166325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:51.167600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:51.169121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:51.171125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 132/264] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:51 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:31:51.177699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:51.213273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:51.326403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:51.356749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6632f-96a3-4c4c-81e2-70e8b7c69d6b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:51.368661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960e4b-da98-4708-85b3-13774b308047 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:51.429666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:51.430684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:51.431179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:51.431681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] PATH_INFO: `/v3/users/92fc31babd1942d3bbe8df569ab52a1a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:51.433205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] RBAC: Authorizing `identity:get_user(user_id=92fc31babd1942d3bbe8df569ab52a1a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:51.435649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:51.437612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 133/265] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:51 2022] GET /identity/v3/users/92fc31babd1942d3bbe8df569ab52a1a => generated 283 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:51.443415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:51.446374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=92fc31babd1942d3bbe8df569ab52a1a) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:51.450832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:51.466971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 133/266] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:51 2022] GET /identity/v3/role_assignments?user.id=92fc31babd1942d3bbe8df569ab52a1a&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:51.594758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e377b1-bc82-4a95-8e86-9daf637d896f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:51.642010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:51.643182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:51.643686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:51.644154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:51.668785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:51.736970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:51.738895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1cee-4fbc-4509-a0c0-eef69b6b8481 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:51.867937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 134/267] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:51.873771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:51.992701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.014881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83574eb-5a05-41ac-9681-ed2b5686e4de None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:52.028442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7c56-1fde-4b5a-8e7b-b774e7e8e32a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.028769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7c56-1fde-4b5a-8e7b-b774e7e8e32a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.029022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a7c56-1fde-4b5a-8e7b-b774e7e8e32a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.030553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 135/268] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:52.036941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758ab2-6a90-4f11-a618-246cecdb3145 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.037475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758ab2-6a90-4f11-a618-246cecdb3145 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.037971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17758ab2-6a90-4f11-a618-246cecdb3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.058451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-17758ab2-6a90-4f11-a618-246cecdb3145 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:52.060729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-17758ab2-6a90-4f11-a618-246cecdb3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:52.075176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:52.076186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.076686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.077218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.078573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:52.081334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:52.085925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 134/269] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:51 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:52.093065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.155226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.189086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 136/270] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:52.190805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931932-dae1-4533-a3ac-feff5f784b39 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.192053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931932-dae1-4533-a3ac-feff5f784b39 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.192550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad931932-dae1-4533-a3ac-feff5f784b39 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.195144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 137/271] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:52.197190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a46f-0de4-4340-a3ab-caa391570715 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.197881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a46f-0de4-4340-a3ab-caa391570715 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.198326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a46f-0de4-4340-a3ab-caa391570715 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.200454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 138/272] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:52.201926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b765-63a6-49bd-a0d5-b7beb260b952 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.202454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b765-63a6-49bd-a0d5-b7beb260b952 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.202880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b765-63a6-49bd-a0d5-b7beb260b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.227012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2d34b765-63a6-49bd-a0d5-b7beb260b952 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:52.228212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2d34b765-63a6-49bd-a0d5-b7beb260b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:52.271004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9a84-5a28-4fc1-b119-b1b7bbe63c4c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:52.320387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 139/273] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:52.321850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.322154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.322427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.324957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:52.325908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.326459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.326941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.327957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=92fc31babd1942d3bbe8df569ab52a1a) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:52.328856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:52.333046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:52.347906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:52.353847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:52.356330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 135/274] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/role_assignments?user.id=92fc31babd1942d3bbe8df569ab52a1a&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:52.453020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 140/275] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:52.539944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.559166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.653305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df98b14-b5f8-4881-a3ed-fdebcd08367a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:52.656587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.694429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:52.695075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.695344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.695610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.710226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:52.715981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:52.717237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:52.718857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:52.720422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 136/276] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:52.729441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.806758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d92c11-db68-4ed0-bd54-9c124340fc2f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:52.825460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.844201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:52.845227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.845716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.845989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.855320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd48e7-b365-4560-bdae-7e281d88a28d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:52.856630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:52.861483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:52.862370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:52.863151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 141/277] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:52.863829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.892814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:52.893955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:52.894421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:52.894922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:52.895757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:52.896220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:52.898039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:52.907561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 137/278] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:52.908565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:52.975311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:52.978975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5333-d211-4910-aeeb-fe90ace4ce14 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.015634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab97ab-c9bd-4210-9277-3c7f5e2bb1ed None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.017294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.017936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.018204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.018468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.019589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.021074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.022649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 142/279] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.023754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.053871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.054479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.054748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.055019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.055673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:53.055966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.057425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.059788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:53.066878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 138/280] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.067651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.123020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66587449-7231-4d5d-9c53-24e1fb29701b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.158038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.158668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.158939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.159202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] PATH_INFO: `/v3/users/8885ea7c8459413bae27be46c2c6be08` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.160313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8885ea7c8459413bae27be46c2c6be08)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.161779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861a51-ad1a-4bb4-aa54-354a2c8d59e3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.163351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 143/281] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/users/8885ea7c8459413bae27be46c2c6be08 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.164627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa58fa-9bb2-4054-ba5e-2988811c8db8 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.164865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa58fa-9bb2-4054-ba5e-2988811c8db8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.165163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa58fa-9bb2-4054-ba5e-2988811c8db8 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.166331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 144/282] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:53.167037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa58fa-9bb2-4054-ba5e-2988811c8db8 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.174945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907a38-0d79-4ed3-966b-ca8d618f4954 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.203798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:53.211204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.211815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.212086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.212370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.213046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.214543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.238069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 139/283] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:31:53 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:53.245154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.274769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa58fa-9bb2-4054-ba5e-2988811c8db8 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.314151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.314715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.315135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:53.315716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.316054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] PATH_INFO: `/v3/users/f700ca1af0cc463480e3026f5a1e9b4b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.331703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f700ca1af0cc463480e3026f5a1e9b4b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.333222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2628793-a183-441f-9164-cb3456ddf1e5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.335135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 145/284] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/users/f700ca1af0cc463480e3026f5a1e9b4b => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.336156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.336435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.336703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.360977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:53.361995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:53.375648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75c4de-8ab9-43b5-9947-1e5e5a2f99f5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.413671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.414319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.414596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.414862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.416066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.417790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.419456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 140/285] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.420605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.449470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 146/286] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:53.452440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.478950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:53.554927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b17ae-08e9-4d40-9453-659eca281ae7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.569881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becebc17-103d-40af-8cd8-3ef0d88447cc None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.584217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:53.601002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.601622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.601892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.602157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.602885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, user.id=f700ca1af0cc463480e3026f5a1e9b4b, scope.system=all) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:53.603246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.604711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.606006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.606355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.606982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.606982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/8885ea7c8459413bae27be46c2c6be08/roles/697ae27283084dfab686c35a840eb508` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.608812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, user_id=8885ea7c8459413bae27be46c2c6be08, role_id=697ae27283084dfab686c35a840eb508)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:53.610280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:53.610776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 141/287] 10.222.0.93 () {56 vars in 1308 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/role_assignments?user.id=f700ca1af0cc463480e3026f5a1e9b4b&scope.system=all&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:53.629463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 147/288] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:31:53 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/users/8885ea7c8459413bae27be46c2c6be08/roles/697ae27283084dfab686c35a840eb508 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:53.753476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:53.864402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc47da-45bf-4213-9839-b897963e33da None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:53.900685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:53.901791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:53.902259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:53.902717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:53.913607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:53.919506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:53.920377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:53.921203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:53.923502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 142/289] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:53.929635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:54.028929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:54.049956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88989fe-3690-495d-a1bd-ea3bd31936a1 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:54.100333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:54.100977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:54.101257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:54.101527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:54.102211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:54.102509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:54.103893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:54.117529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 148/290] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:54.119538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:54.188416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:54.271807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e6235-e488-4169-99e9-1eee02affd01 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:54.316433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:54.317227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:54.317436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:54.317757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] PATH_INFO: `/v3/users/153ab4de04484ceeaed845beb8ef15fc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:54.318920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] RBAC: Authorizing `identity:get_user(user_id=153ab4de04484ceeaed845beb8ef15fc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:54.320371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:54.322217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 143/291] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:54 2022] GET /identity/v3/users/153ab4de04484ceeaed845beb8ef15fc => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:54.330024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:54.471634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f074c-f9e4-445f-b767-2c57481ecdab None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:54.506838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:54.507813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:54.508282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:54.508737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:54.525277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:54.589621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:54.591581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:54.719402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 149/292] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:54.726045 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:54.874994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54484cb-6f27-4d58-8a9c-117e61148a92 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:54.888965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:54.915046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:54.915689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:54.915966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:54.916239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:54.917471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:54.918925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336a2eb-79fb-4f78-ba09-e0ae2132d472 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:54.920566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 144/293] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:54 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:54.926813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:54.993643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:55.059395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e55a2-8ca1-44f8-9207-1f44a9aa8d33 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:55.109559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:55.110179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:55.110449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:55.110716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:55.111438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=153ab4de04484ceeaed845beb8ef15fc) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:55.111735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:55.113216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5944df-b9be-4226-a3f5-ca8abdeeb36a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:55.122941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 150/294] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:54 2022] GET /identity/v3/role_assignments?user.id=153ab4de04484ceeaed845beb8ef15fc&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:55.715036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179a08-8ac5-4544-a044-e149ed639e6c None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:55.715565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179a08-8ac5-4544-a044-e149ed639e6c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:55.715565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179a08-8ac5-4544-a044-e149ed639e6c None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:55.717152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 145/295] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:55.720198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef028-e894-4b97-a95b-e3308a1d5f38 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:55.720598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef028-e894-4b97-a95b-e3308a1d5f38 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:55.720785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ef028-e894-4b97-a95b-e3308a1d5f38 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:55.722073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 151/296] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:55.726280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6d26-e9b3-438c-b905-712ff5494706 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:55.726795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6d26-e9b3-438c-b905-712ff5494706 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:55.727067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6d26-e9b3-438c-b905-712ff5494706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:55.734952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66723998-45b6-4f60-ac22-891fc4ca15f9 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:55.735237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66723998-45b6-4f60-ac22-891fc4ca15f9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:55.735508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66723998-45b6-4f60-ac22-891fc4ca15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:55.756683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4ced6d26-e9b3-438c-b905-712ff5494706 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:55.757218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-66723998-45b6-4f60-ac22-891fc4ca15f9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:55.758429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-66723998-45b6-4f60-ac22-891fc4ca15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:55.758686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4ced6d26-e9b3-438c-b905-712ff5494706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:55.831513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 152/297] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:55.849023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 146/298] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:56.011662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b379-9891-4aa7-9c04-582676de5e08 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.012033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b379-9891-4aa7-9c04-582676de5e08 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.012219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b379-9891-4aa7-9c04-582676de5e08 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.013659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 153/299] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:56.018998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.019284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.019555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.038342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:56.039529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:56.074086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0c43-812a-47e3-b1c4-6c56d5bc6dd5 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.074358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0c43-812a-47e3-b1c4-6c56d5bc6dd5 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.074878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0c43-812a-47e3-b1c4-6c56d5bc6dd5 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.076533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 154/300] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:31:56.081883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.082458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.082949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.102289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:56.103798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:56.110223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 147/301] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:56.111074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.143293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.162514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.179455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 155/302] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:31:56.189086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.223431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a409fd1-1efd-4c89-a32f-b8a4465ad16b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.266891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.267458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.267731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.267995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.269391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.271119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:56.272982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 148/303] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:56.278995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.318781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daa816-b351-4e49-b0b6-2cc99363d3a9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.368993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.369647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.369943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.370226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.382872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:56.389514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:56.390450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:56.391246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:56.393249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 156/304] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:56.394383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.395331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f9324-8521-4ee2-91bf-5cb001ca3d29 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.407834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.427772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.437897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.438802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.439311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.440191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] PATH_INFO: `/v3/groups` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.441079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.443143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:56.464510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 149/305] 10.222.0.93 () {60 vars in 1134 bytes} [Wed Aug 24 15:31:56 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:56.465383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.507666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0b2c5-7172-48dd-89a0-493a7d5c95d7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.554058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.554623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.554894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.555158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.566815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:56.571635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:56.572763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:56.573986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:56.577838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 157/306] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:56.578809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.600307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c3f75-4270-477c-9f2f-7a7ea9248cf7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.644588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.647546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.647546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.647546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.648515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:56.648806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.650225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:56.658631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 150/307] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:56.663993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.680476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.690578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ace724-eb71-4c52-a792-22287b58fc28 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.697420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.727167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.727907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.728114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.728381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.739476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:56.744397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:56.745600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 158/308] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:56.746513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.781164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b420a9-12bf-43b7-a9a0-bbe1a53a638b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.816457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.817027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.817304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.817575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.818241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:56.818543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.819928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:56.833064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 151/309] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:56.833064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.863576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e7a1-e897-43c3-87ff-fde50a62f96b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.898620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.899266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.899543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.899805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] PATH_INFO: `/v3/users/7108393cf5144c7699731f9016a8ffe2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.913748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] RBAC: Authorizing `identity:get_user(user_id=7108393cf5144c7699731f9016a8ffe2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.915239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:56.917115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 159/310] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/users/7108393cf5144c7699731f9016a8ffe2 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:56.917743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:56.928310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.943512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.952854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d09d6-e710-430d-8ca6-2e22fedb6628 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:56.988153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:56.988763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:56.989069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:56.989338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:56.990030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:56.990309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:56.991865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.000463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 152/311] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:57.001103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.026876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65600a42-48fb-4e4a-8aa8-4e81e3a1da85 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.062129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.062907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.063276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.063607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] PATH_INFO: `/v3/users/f700ca1af0cc463480e3026f5a1e9b4b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.065004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=f700ca1af0cc463480e3026f5a1e9b4b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.066768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.072799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 160/312] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:56 2022] GET /identity/v3/users/f700ca1af0cc463480e3026f5a1e9b4b => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:57.072799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.107717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2ea2-564a-4756-bafb-0ed71847f595 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.152746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.153705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.154137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.154562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.155780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, user.id=7108393cf5144c7699731f9016a8ffe2, scope.system=all) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:57.156265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.158764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.164173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:57.166431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 153/313] 10.222.0.93 () {56 vars in 1308 bytes} [Wed Aug 24 15:31:57 2022] GET /identity/v3/role_assignments?user.id=7108393cf5144c7699731f9016a8ffe2&scope.system=all&role.id=697ae27283084dfab686c35a840eb508 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:57.167822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.203719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:57.207341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec171-035b-4071-a92e-1ea02e00f8d9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.252879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079615-08ab-4872-a318-507147050ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.253823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079615-08ab-4872-a318-507147050ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.254234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079615-08ab-4872-a318-507147050ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.254636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48079615-08ab-4872-a318-507147050ae6 None admin] PATH_INFO: `/v3/users/8885ea7c8459413bae27be46c2c6be08` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.256198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079615-08ab-4872-a318-507147050ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=8885ea7c8459413bae27be46c2c6be08)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.259048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48079615-08ab-4872-a318-507147050ae6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.261932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 161/314] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:57 2022] GET /identity/v3/users/8885ea7c8459413bae27be46c2c6be08 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:57.270381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079615-08ab-4872-a318-507147050ae6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.327749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f600a8-a48f-4181-a345-e836b7368806 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.383492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.384551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.385071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.385535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] PATH_INFO: `/v3/system/users/f700ca1af0cc463480e3026f5a1e9b4b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.387682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f700ca1af0cc463480e3026f5a1e9b4b, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.389797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.405270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 154/315] 10.222.0.93 () {58 vars in 1334 bytes} [Wed Aug 24 15:31:57 2022] PUT /identity/v3/system/users/f700ca1af0cc463480e3026f5a1e9b4b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:31:57.430115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48079615-08ab-4872-a318-507147050ae6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.473884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.474955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.475446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.475931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.494501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:57.564204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.565778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.670222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 162/316] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:57.675781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.768619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:57.785684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847bd9-2405-4b60-b466-8892728623ea None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.821174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.821820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.822096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.822367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.823554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.825082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b658-de6a-4d9b-8b53-d214daa930b5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.827140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 155/317] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:31:57 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:57.833216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:57.880891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:57.937476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf54a39-6d4d-491f-b348-0b374a54bccd None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:57.972256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:57.973057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:57.973193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:57.973455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:57.974188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, scope.project.id=2a676a719a8d4985a2c1fd2228915b06, user.id=8885ea7c8459413bae27be46c2c6be08) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:57.974491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:57.975933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa73920-b2cf-43d9-8b6f-9f349c7dbdcd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:57.982340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 163/318] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:31:57 2022] GET /identity/v3/role_assignments?user.id=8885ea7c8459413bae27be46c2c6be08&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=697ae27283084dfab686c35a840eb508 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:58.393580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6128e-63e3-45b5-8448-2aebd1ffcea2 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:58.393980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6128e-63e3-45b5-8448-2aebd1ffcea2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:58.394079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6128e-63e3-45b5-8448-2aebd1ffcea2 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:58.395621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 156/319] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:58.401158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:58.401438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:58.401774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:58.419790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:58.420942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:58.492371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 164/320] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:58.752558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6128e-63e3-45b5-8448-2aebd1ffcea2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:58.859748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6128e-63e3-45b5-8448-2aebd1ffcea2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:58.893665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:58.894317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:58.894588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:58.894856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:58.895961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:58.897517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406460-266f-4f1a-9ef7-1770c446e062 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:58.899617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 157/321] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:58.905223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:58.946149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:59.008400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f7d4-930c-43b3-b53d-d2bbe572d364 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:59.042673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:59.043279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.043548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.043812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] PATH_INFO: `/v3/groups` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.044423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:59.045883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376334-688e-4252-b1cd-e199b1d1f5f4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:59.072493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 165/322] 10.222.0.93 () {60 vars in 1134 bytes} [Wed Aug 24 15:31:58 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:31:59.137213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac724538-3a2e-4af0-99f8-87434abb76cc None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.137489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac724538-3a2e-4af0-99f8-87434abb76cc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.137759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac724538-3a2e-4af0-99f8-87434abb76cc None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.139151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 158/323] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:59.145120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eec9ab-24ad-4182-b973-a4d03cba492f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.145394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eec9ab-24ad-4182-b973-a4d03cba492f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.145663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eec9ab-24ad-4182-b973-a4d03cba492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.165222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c3eec9ab-24ad-4182-b973-a4d03cba492f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:59.166432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3eec9ab-24ad-4182-b973-a4d03cba492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:59.247196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 166/324] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:59.371421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929089e-3270-4941-933f-f6eca95f4046 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.371602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929089e-3270-4941-933f-f6eca95f4046 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.371865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929089e-3270-4941-933f-f6eca95f4046 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.373252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 159/325] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:31:59.378728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.379009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.379282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.397637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:31:59.399178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:31:59.423450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:59.469442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 167/326] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:59.515941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929089e-3270-4941-933f-f6eca95f4046 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:59.540030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:59.630888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929089e-3270-4941-933f-f6eca95f4046 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:59.666139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:59.666781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.667052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.667378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.677740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:59.682638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:59.683597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:59.684391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 160/327] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:59.691382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:59.755617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:59.822855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3c66-7bcf-40ce-9b0c-449910cabc1b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:59.854627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:59.867146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:59.867770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.868044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.868307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.869008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:31:59.869301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:31:59.870773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:31:59.878298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4c1a-7d36-4c3b-a232-f016cd963206 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:31:59.884836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 168/328] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:31:59.890712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:31:59.920462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:59.930262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:31:59.930917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:31:59.931195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:31:59.931461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:31:59.942753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:31:59.948035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:31:59.950168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:31:59.952099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 161/329] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:31:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:31:59.956948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:00.006853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c56ac-c454-4c69-889d-7f3587d7992d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:00.046725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:00.047509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:00.047807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:00.048050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] PATH_INFO: `/v3/users/7108393cf5144c7699731f9016a8ffe2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:00.049221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] RBAC: Authorizing `identity:get_user(user_id=7108393cf5144c7699731f9016a8ffe2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:00.050662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:00.053576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 169/330] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:31:59 2022] GET /identity/v3/users/7108393cf5144c7699731f9016a8ffe2 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:00.058305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:00.100056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37e056-010c-42df-b7dc-6793906514c8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:00.157734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:00.158282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:00.158556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:00.158823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:00.159511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:00.159809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:00.160279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:00.161263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:00.170516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 162/331] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:00.174307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29cc28-fdd3-4c2d-b9e3-349d555ac5ee None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:00.175994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:00.178798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:00.211901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:00.214408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:00.214408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:00.214408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] PATH_INFO: `/v3/system/users/7108393cf5144c7699731f9016a8ffe2/roles/697ae27283084dfab686c35a840eb508` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:00.214877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7108393cf5144c7699731f9016a8ffe2, role_id=697ae27283084dfab686c35a840eb508)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:00.220753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:00.229752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 170/332] 10.222.0.93 () {58 vars in 1334 bytes} [Wed Aug 24 15:32:00 2022] PUT /identity/v3/system/users/7108393cf5144c7699731f9016a8ffe2/roles/697ae27283084dfab686c35a840eb508 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:00.317560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fb84b-f9d6-4280-8650-da93b8385c23 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:00.356261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:00.356968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:00.357252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:00.357562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] PATH_INFO: `/v3/users/f700ca1af0cc463480e3026f5a1e9b4b` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:00.358763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] RBAC: Authorizing `identity:get_user(user_id=f700ca1af0cc463480e3026f5a1e9b4b)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:00.360224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b2bcf-9ad6-4761-aa88-8f92074c9144 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:00.362274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 163/333] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:32:00 2022] GET /identity/v3/users/f700ca1af0cc463480e3026f5a1e9b4b => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:00.368195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:00.477063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9be946-7187-4511-80c8-bd4741c0c3c0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:00.523120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:00.524098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:00.524373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:00.524708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:00.525533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] RBAC: Adding query filter params (role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, user.id=f700ca1af0cc463480e3026f5a1e9b4b, scope.system=all) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:00.525729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:00.527245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969d858-af1c-4279-bac9-e8974eb10fac None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:00.541084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 171/334] 10.222.0.93 () {56 vars in 1308 bytes} [Wed Aug 24 15:32:00 2022] GET /identity/v3/role_assignments?user.id=f700ca1af0cc463480e3026f5a1e9b4b&scope.system=all&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:01.596142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036cbfb-85fd-49af-8c00-8a4ef43991ab None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:01.596666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036cbfb-85fd-49af-8c00-8a4ef43991ab None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:01.596666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036cbfb-85fd-49af-8c00-8a4ef43991ab None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:01.598063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 164/335] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:01.603742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05d81-145f-47e9-89e2-834ea37f70bd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:01.604183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05d81-145f-47e9-89e2-834ea37f70bd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:01.604358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05d81-145f-47e9-89e2-834ea37f70bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:01.624936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b6c05d81-145f-47e9-89e2-834ea37f70bd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:01.630210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b6c05d81-145f-47e9-89e2-834ea37f70bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:01.633480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:01.705834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 172/336] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:01.813961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5f21-9168-4b07-ba96-9dda83cd66f8 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:01.814291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5f21-9168-4b07-ba96-9dda83cd66f8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:01.814506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5f21-9168-4b07-ba96-9dda83cd66f8 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:01.815863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 165/337] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:01.822313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d57be-30ce-424f-bef0-34366e57122f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:01.822594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d57be-30ce-424f-bef0-34366e57122f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:01.822856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d57be-30ce-424f-bef0-34366e57122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:01.846247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-699d57be-30ce-424f-bef0-34366e57122f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:01.847402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-699d57be-30ce-424f-bef0-34366e57122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:01.930644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 173/338] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:02.066252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5f21-9168-4b07-ba96-9dda83cd66f8 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.150420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:02.184941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5f21-9168-4b07-ba96-9dda83cd66f8 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:02.224265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:02.224943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.225222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.225493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.241180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:02.246641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:02.247502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:02.248306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 166/339] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:02.255353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d57be-30ce-424f-bef0-34366e57122f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.343341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:02.380823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d57be-30ce-424f-bef0-34366e57122f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:02.425546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:02.426094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.426369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.426640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.427317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:02.427619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:02.429047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:02.439374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 174/340] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:02.443907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.539014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.614693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497d853-92e6-421c-b2e9-8eba73f6cdff None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:02.662797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:02.686296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:02.687279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.687759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.688246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.688474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1ee8d-d84a-4a37-b21e-5595996726ac None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:02.735649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:02.736295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.736572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.736840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.750905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:02.761294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:02.766410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:02.767345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:02.768278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 175/341] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:02.773757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.796723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:02.798367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1864e-f4ca-42c5-a764-15839748a938 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:02.895048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c193-8fd5-4f26-b42c-8ff561c9f713 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:02.930602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:02.931327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.931606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.931878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.932549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:02.932928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:02.934314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5111b-1ff8-4891-a2cc-698f4bb7f05d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:02.947656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 176/342] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:02.949132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea9c4-ffe4-4334-b1d6-611fca558f91 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.949743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea9c4-ffe4-4334-b1d6-611fca558f91 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.950152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea9c4-ffe4-4334-b1d6-611fca558f91 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.951659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 177/343] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:02.953701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 167/344] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:02.956711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea9c4-ffe4-4334-b1d6-611fca558f91 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:02.957469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:02.957855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:02.958220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:02.988647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:02.990153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:03.019807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.065311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.089404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 168/345] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:03.091717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.161391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea9c4-ffe4-4334-b1d6-611fca558f91 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.210211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.210751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.211031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.211289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.283828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c442d6-7664-4bd3-ba56-6e5af8f9e3f6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.304130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:03.310048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ac6c7-ecc3-42e5-aff2-8fc9bc532998 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:03.326529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b6167-0474-4107-9973-476727750a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.327192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6167-0474-4107-9973-476727750a78 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.327470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6167-0474-4107-9973-476727750a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.327747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6167-0474-4107-9973-476727750a78 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.328923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6167-0474-4107-9973-476727750a78 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:03.330407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6167-0474-4107-9973-476727750a78 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:03.337357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 169/346] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:03.338749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c31e-5e18-48fc-a3c1-8fdad5eedfa0 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.339345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c31e-5e18-48fc-a3c1-8fdad5eedfa0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.339627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c31e-5e18-48fc-a3c1-8fdad5eedfa0 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.341056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 170/347] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:03.341920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729029-32ac-485b-9700-fa727614b988 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.342195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729029-32ac-485b-9700-fa727614b988 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.342464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729029-32ac-485b-9700-fa727614b988 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.343859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 171/348] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:03.346704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729029-32ac-485b-9700-fa727614b988 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.374629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.375608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.427487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 178/349] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:03.428789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.429106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.429377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.455197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:03.456926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:03.472952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729029-32ac-485b-9700-fa727614b988 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.514595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.515241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.515514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.515779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.522778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:03.524786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1375a-37eb-4ea1-a575-30d157c31213 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:03.526900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 172/350] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:03.533114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.533395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.533671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.536248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 179/351] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:03.538233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.556493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:03.557746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:03.636202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.639845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 173/352] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:03.640696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.664391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffb269-787f-44df-bb80-fa5f23d8f682 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.689894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:03.713651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.714358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.714635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.714906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.716463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:03.717921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:03.720023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 180/353] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:03.720990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.835101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd973b10-15b1-4e80-9648-4586b268446d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.858337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d739181-c862-4d4c-bba5-3f5119855ae0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:03.900982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.901845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.902356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.902823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.909514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:03.910321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:03.910597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:03.910862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:03.911594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:03.911924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:03.914020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:03.916192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:03.920267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 181/354] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:03.921627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:03.922539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:03.923377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:03.924003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.925807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 174/355] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:03.926812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:03.959106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.075207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.090351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236a657-c43a-4185-9cb9-6ed4f7e63575 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.102000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0896c1-b78c-4c93-912d-ed1e29652f46 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.144424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.144424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.144724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.144805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.146458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.148688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.151623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 182/356] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:04.152464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.160323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.161263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.161553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.161824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.180180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:04.185685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:04.186581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:04.187391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 175/357] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:04.188199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.260981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.282377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83a13-1f7f-465b-8de1-b74d9f04f972 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.330626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.331233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.331503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.331767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.332429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:04.332723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.334149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.337787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e3c91-ef6b-4ebc-9efc-a5e35ccc0b85 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.346090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 183/358] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:04.348976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.383034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.383918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.384662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.385366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.402040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1679f11f-ce90-4d34-bf4b-a9b109cf689d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:04.409930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:04.410864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:04.411781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:04.414899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 176/359] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:04.416685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787f46-8bb0-4aa5-b2e1-1677d7f7f5fd None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.417241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787f46-8bb0-4aa5-b2e1-1677d7f7f5fd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.417707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787f46-8bb0-4aa5-b2e1-1677d7f7f5fd None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.419960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 177/360] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:04.420857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88787f46-8bb0-4aa5-b2e1-1677d7f7f5fd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.424150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.479685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2546-ed4f-4ee4-a9ff-133ded5423f8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.526653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.527322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.527554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.527819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.528872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:04.528872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.530370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.539330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 184/361] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:04.540357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.555643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.556783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88787f46-8bb0-4aa5-b2e1-1677d7f7f5fd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.594499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.595127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.595389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.595656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.596388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:04.596625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.598726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.608197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 178/362] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:04.611329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.673233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b9230-e679-47eb-88b1-dff109459222 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.678884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.718440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.719773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.720269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.720731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.721602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255dcb8-11d2-4693-bf18-24820f7bc1d5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:04.767533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:04.768157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.768428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.768693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.769458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:04.769760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.771584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e5490-ea5c-4e72-a7c9-aaf53034d6a5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.786757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 179/363] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:04.788434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:04.788713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:04.789021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:04.799817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:04.801310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:04.811471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:04.813361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:04.813843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:04.894720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 180/364] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:04.895486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.971693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 185/365] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:04.972383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:04.980162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.055936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26070f-50a6-48aa-afbb-534336129815 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.125253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.125943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.126359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.126634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] PATH_INFO: `/v3/users/7108393cf5144c7699731f9016a8ffe2` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.130574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] RBAC: Authorizing `identity:get_user(user_id=7108393cf5144c7699731f9016a8ffe2)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.132114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.134033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 181/366] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/users/7108393cf5144c7699731f9016a8ffe2 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.134569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.156892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313143a-b2a4-4efc-9a7c-6d8d31af51c6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.176514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.225461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.226467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.227009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.227538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.272280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67733e4-987a-45e9-b72e-8f96c637a093 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.302087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.314946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.315761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.316127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.316494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.317791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.319342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.321124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 182/367] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.321977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.338962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.340960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.424364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70500d2b-bd07-4e1c-9790-432630af87dd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.456378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 186/368] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:05.457575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.459991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.460540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.460816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.461115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.462479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] RBAC: Adding query filter params (role.id=697ae27283084dfab686c35a840eb508, user.id=7108393cf5144c7699731f9016a8ffe2, scope.system=all) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:05.462479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.463587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.471484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.476169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 183/369] 10.222.0.93 () {56 vars in 1308 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/role_assignments?user.id=7108393cf5144c7699731f9016a8ffe2&scope.system=all&role.id=697ae27283084dfab686c35a840eb508 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.477015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.534943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.576193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9bf5a-72cc-4e19-bb34-f8c1bc1b3c77 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.590596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa7e6-5105-4a84-bcd2-0a5f513e9609 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.616031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.617139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.617615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.618080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.627919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.628573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.628849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.629150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.630306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.631779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.631989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:05.633459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 184/370] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.634230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:05.637931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:05.638822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:05.639637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:05.642231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 187/371] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:05.643303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.722809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.752110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9711b9b-29c7-40c6-87dd-54d379827dae None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.761089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a0fd2-5fb6-4481-bb1e-919aeabfebc8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.771537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:05.790745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.791619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.792168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.792168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.793389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.794847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.796512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 185/372] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.797360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.805253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.806235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.806808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.807272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.808301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=2a676a719a8d4985a2c1fd2228915b06) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:05.808865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.810672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.817518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 188/373] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.818598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.909898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75f2d-92c9-4cb9-8793-1ef2a4d022e3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.934610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d5bfa-55db-442d-b7ad-fddc29896c42 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:05.948040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.948706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.949029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.949305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.949981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:05.950282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.951750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.961749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 186/374] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.967633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.977885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:05.978970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:05.979519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:05.979995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:05.981472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:05.983245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:05.985321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 189/375] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:05.992283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:05.995544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.024211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.085991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b79a4-8b0a-475c-a3f7-8ae6ae9a1b4c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:06.110162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca47b9-4ad9-4922-aefd-ce5fcfdb5516 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:06.124815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:06.125491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.125769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.126043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.150212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:06.151197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.151768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.152235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.153694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=2a676a719a8d4985a2c1fd2228915b06) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:06.154229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:06.156044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f66c7-0895-4059-a475-4dd5de4bda62 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:06.163025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 190/376] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:06.203398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:06.204980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:06.269736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.272194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001694-5e79-4424-a798-8cd952e97119 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.272662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001694-5e79-4424-a798-8cd952e97119 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.273496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50001694-5e79-4424-a798-8cd952e97119 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.275512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 191/377] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:06.281989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.282597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.283093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.320315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:06.320513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 187/378] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:06.322075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:06.326599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:06.428925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.435321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 192/379] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:06.436636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394de9fd-8d24-41dc-bdf6-ab27cfdc44af None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:06.472325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:06.472999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.473280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.473552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] PATH_INFO: `/v3/projects/91eb9a5b14d843409de915748f661903` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.474701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] RBAC: Authorizing `identity:get_project(project_id=91eb9a5b14d843409de915748f661903)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:06.476383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:06.478391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 188/380] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:06 2022] GET /identity/v3/projects/91eb9a5b14d843409de915748f661903 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:06.484079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:06.588487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bceb82-6aa0-439c-aeb9-aaf8213dc307 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:06.627788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:06.628443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.628776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.629085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] PATH_INFO: `/v3/groups/aab714d35d7147ca963ffb1007402961` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.635550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] RBAC: Authorizing `identity:get_group(group_id=aab714d35d7147ca963ffb1007402961)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:06.637074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:06.638780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 193/381] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:06 2022] GET /identity/v3/groups/aab714d35d7147ca963ffb1007402961 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:06.645389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:06.665403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.751050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49631fa-b955-491b-8444-22a1c2f91a8d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:06.786282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248076-362d-4283-bda4-83724026776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:06.786945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248076-362d-4283-bda4-83724026776e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:06.787221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248076-362d-4283-bda4-83724026776e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:06.787532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b248076-362d-4283-bda4-83724026776e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:06.788277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248076-362d-4283-bda4-83724026776e None admin] RBAC: Adding query filter params (group.id=aab714d35d7147ca963ffb1007402961, role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=91eb9a5b14d843409de915748f661903) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:06.788583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248076-362d-4283-bda4-83724026776e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:06.790072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b248076-362d-4283-bda4-83724026776e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:06.796367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 189/382] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:06 2022] GET /identity/v3/role_assignments?group.id=aab714d35d7147ca963ffb1007402961&scope.project.id=91eb9a5b14d843409de915748f661903&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:06.852781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:06.936879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:06.995361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3420bba-6306-4d9d-8f67-af06162e54cd None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:07.033433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:07.034083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.034362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.034632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.046149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:07.052445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:07.053366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:07.054157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 194/383] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:07.060856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248076-362d-4283-bda4-83724026776e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:07.149400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:07.169242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b248076-362d-4283-bda4-83724026776e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:07.203988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:07.204616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.205174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.205448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.208572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:07.208572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:07.208572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:07.218347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 190/384] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:07.222457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:07.336942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daae2c-3586-4ce2-bead-4197ff8d54c5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:07.361474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:07.379131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:07.380343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.380821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.381356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.382696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:07.384365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389346f-67e5-48bd-9dfa-b63ea3f679c5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:07.386604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 195/385] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:07 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:07.392021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:07.417980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05143d2-1ad3-4988-8e3b-30222b6b8aed None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.418575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05143d2-1ad3-4988-8e3b-30222b6b8aed None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.419045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05143d2-1ad3-4988-8e3b-30222b6b8aed None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.421151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 196/386] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:07.430342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.430958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.431451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.460653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:07.463851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:07.560924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44587853-3d21-4691-9f83-d46978017c05 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:07.594317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:07.594317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.594317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.594317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.595478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:07.597082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:07.598854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 197/387] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:07.603577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 191/388] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:07 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:07.605054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:07.726384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6cef-0685-431c-8cfd-d4107c4967da None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:07.749529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:07.765354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:07.766132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:07.766405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:07.766673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/groups/a7230ce4969f4ced86e239ef4ca14324/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:07.768813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, group_id=a7230ce4969f4ced86e239ef4ca14324, role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:07.770300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:07.793078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 198/389] 10.222.0.93 () {58 vars in 1442 bytes} [Wed Aug 24 15:32:07 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/groups/a7230ce4969f4ced86e239ef4ca14324/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:32:07.887631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:07.905691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:08.010817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc09c-0a44-4f47-8290-9ccb00f4da68 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:08.052002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:08.052645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.052930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.053243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.063869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:08.069168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:08.070065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:08.070957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 192/390] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:08.076290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:08.208034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9b2ad-6d0a-46fc-b7e6-c7757d2a1b41 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:08.259516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:08.260182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.260457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.260770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.261522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:08.261768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:08.263137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:08.277016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 199/391] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:08.282631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:08.397530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:08.448066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e666595-8ba4-403a-a4e7-bc572eaf4ae4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:08.495352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:08.496433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.496926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.497394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.501576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:08.503289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83128ce-dc24-4265-8714-912682655e16 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:08.505444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 193/392] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:08 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:08.510824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:08.589543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:08.611804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99b4d-baf9-4ef7-a924-c74a8ad384a7 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.612081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99b4d-baf9-4ef7-a924-c74a8ad384a7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.612494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99b4d-baf9-4ef7-a924-c74a8ad384a7 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.614230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 194/393] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:08.621553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.621843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.622095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.657758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419af3f-43fc-403b-bc19-e29382d5f706 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:08.675030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:08.676241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:08.695975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:08.696713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.697010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.697278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.698462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:08.700118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:08.704531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 200/394] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:08 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:08.709936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:08.791533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 195/395] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:08.815590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aed5b-e93a-4d41-b94e-1f20e6ad68d2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:08.824756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:08.850445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:08.851036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:08.851667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:08.851940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/groups/a7230ce4969f4ced86e239ef4ca14324/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:08.854226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] RBAC: Authorizing `identity:create_grant(project_id=a678c0d45a094a15b81ac4d24b3853cc, group_id=a7230ce4969f4ced86e239ef4ca14324, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:08.855764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8bfd4-a653-46aa-b264-94bbb2fee1ee None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:08.871280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 201/396] 10.222.0.93 () {58 vars in 1442 bytes} [Wed Aug 24 15:32:08 2022] PUT /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc/groups/a7230ce4969f4ced86e239ef4ca14324/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:32:09.112411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.142926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495fa9a-c458-4652-9aa3-8ae9a85ebca4 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.143449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495fa9a-c458-4652-9aa3-8ae9a85ebca4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.143685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495fa9a-c458-4652-9aa3-8ae9a85ebca4 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.145390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 202/397] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:09.152747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.153333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.153799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.178522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:09.180700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:09.193172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:09.248476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60969f74-4348-449b-8e30-8ee5860dbc33 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:09.289358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:09.290271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.290539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.290803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.302597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:09.307604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:09.308487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:09.309318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 196/398] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:09.311376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 203/399] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:09.314724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.422601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde8c78-c2e9-4bba-ba8a-41ff111b95ff None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:09.450353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:09.459467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:09.460086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.460355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.460620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.461321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:09.461618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:09.463008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:09.471651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 197/400] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:09.477397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.577944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:09.582151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355c402-6ae6-4e24-acd9-c0a526967ad4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:09.622503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:09.623539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.624010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.624469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.625870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:09.627516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7ff67-77fd-41da-b3d4-b31030f3e88c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:09.629699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 204/401] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:09 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:09.636941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.650373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7df2f-6bc3-47fc-9b75-0b778c944220 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.650965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7df2f-6bc3-47fc-9b75-0b778c944220 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.651556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7df2f-6bc3-47fc-9b75-0b778c944220 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.653573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 205/402] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:09.659447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.660075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.660541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.690603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:09.692224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:09.764134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d93f4-731a-4b33-b150-7015f1cc3496 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:09.807281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:09.807956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:09.808227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:09.808492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:09.812204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:09.813703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:09.820707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 198/403] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:09 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:09.830389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 206/404] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:09.832017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.888616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:09.938796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:09.992938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:09.999043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d534e7-5c5a-499b-84d7-c1cffd744d2d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.035813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.036447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.036717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.037005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.048310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:10.053474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:10.054355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:10.055243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 207/405] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:10.060738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.065381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c658-d01e-4260-b82b-94db739e04a2 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.129309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.129990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.130245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.130512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/groups/a7230ce4969f4ced86e239ef4ca14324/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.132969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, group_id=a7230ce4969f4ced86e239ef4ca14324, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.135534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.153838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 199/406] 10.222.0.93 () {58 vars in 1442 bytes} [Wed Aug 24 15:32:09 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/groups/a7230ce4969f4ced86e239ef4ca14324/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:32:10.155456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.204853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b71-16da-47ba-b8a1-9de6d55981d6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.261592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.262130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.262480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.262795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.263484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:10.263823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.265396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900b5c6-8480-4bf7-824b-be595f320a87 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.276143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 208/407] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:10.277778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260a8-398b-4878-b72a-f67fa19b3dae None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.278060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260a8-398b-4878-b72a-f67fa19b3dae None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.278326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0260a8-398b-4878-b72a-f67fa19b3dae None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.279673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 209/408] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:10.290061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0260a8-398b-4878-b72a-f67fa19b3dae None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.297066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aaee5-98a8-48ac-a322-3764e221a588 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.325145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:10.325353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:10.351915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.352578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.352854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.353153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.368509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3b38d2c1-9f5d-4696-a384-7e16123b74ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:10.376955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:10.377863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 200/409] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:10.378692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.379405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.379405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.396428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:10.397722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:10.450319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0260a8-398b-4878-b72a-f67fa19b3dae None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.481179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 201/410] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:10.482185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.521814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.522983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.523842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.524343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.525911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.527825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.530084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 210/411] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:10.536591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.640580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:10.662615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3788e-3efc-4b4d-a790-7f61f7e527cc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.700340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.701396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.701944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.702412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.704099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.705833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.709114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 211/412] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:10.716748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.852600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48eae13-6825-4c5b-9609-1c122bb81d52 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.871336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95c6c-e711-4b8a-a3ef-55948569efcd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:10.883827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:10.897897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.899624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.900111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.900581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06/groups/a7230ce4969f4ced86e239ef4ca14324/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.903606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a676a719a8d4985a2c1fd2228915b06, group_id=a7230ce4969f4ced86e239ef4ca14324, role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.905584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.925126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 212/413] 10.222.0.93 () {58 vars in 1442 bytes} [Wed Aug 24 15:32:10 2022] PUT /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06/groups/a7230ce4969f4ced86e239ef4ca14324/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:10.928385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:10.934928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:10.936148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:10.936795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:10.937286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:10.938363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:10.940103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:10.941798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:10.964877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:10.968373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 202/414] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:10.976030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:11.160097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3c57d-4968-4515-a1fb-3b4a571979d9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.182859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a540c5-c35d-4d72-878d-a6bcc49eb99f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.201291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.202281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.202919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.203499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.229322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:11.233125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.233780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.234060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.234339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] PATH_INFO: `/v3/groups/aab714d35d7147ca963ffb1007402961` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:11.236744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:11.237717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:11.238559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:11.239209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] RBAC: Authorizing `identity:get_group(group_id=aab714d35d7147ca963ffb1007402961)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:11.240853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:11.241490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 213/415] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:11.242689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 203/416] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:10 2022] GET /identity/v3/groups/aab714d35d7147ca963ffb1007402961 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:11.248590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:11.248837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:11.339358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:11.343041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:11.386715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e98e6-2958-4e0b-a944-e35f25d77a90 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.459894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a348c2-2d4b-4478-a85d-96b5d56b14d8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.462678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.463822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.463822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.464022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] PATH_INFO: `/v3/projects/91eb9a5b14d843409de915748f661903` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.465816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] RBAC: Authorizing `identity:get_project(project_id=91eb9a5b14d843409de915748f661903)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:11.466949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed1aa-d0ce-410e-902e-913d5dd4dbac None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:11.473186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 214/417] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:11 2022] GET /identity/v3/projects/91eb9a5b14d843409de915748f661903 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:11.473186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd0629-fd3a-4174-957a-f7ab9fee78ce None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.473186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd0629-fd3a-4174-957a-f7ab9fee78ce None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.473186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd0629-fd3a-4174-957a-f7ab9fee78ce None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.488412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 215/418] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:11 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:11.489408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd0629-fd3a-4174-957a-f7ab9fee78ce None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:11.517391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.519185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.519660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.520131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.522404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:11.523569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:11.525522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0454-5b94-4cd3-87b7-170bc72d8712 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:11.536296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 204/419] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:11.538104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.538658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.540727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.560627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:11.562324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:11.636820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 205/420] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:11.638228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:11.674321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:11.756180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c459de-cade-41a7-a44c-ba2352fceba4 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.796037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.797244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.798161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.798643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.828066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd0629-fd3a-4174-957a-f7ab9fee78ce None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:11.895581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:11.896621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:11.899253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:11.899738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] PATH_INFO: `/v3/projects/91eb9a5b14d843409de915748f661903/groups/aab714d35d7147ca963ffb1007402961/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:11.903877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] RBAC: Authorizing `identity:create_grant(project_id=91eb9a5b14d843409de915748f661903, group_id=aab714d35d7147ca963ffb1007402961, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:11.907306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:11.921000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:11.924823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:11.933333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 216/421] 10.222.0.93 () {58 vars in 1442 bytes} [Wed Aug 24 15:32:11 2022] PUT /identity/v3/projects/91eb9a5b14d843409de915748f661903/groups/aab714d35d7147ca963ffb1007402961/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:12.003607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.047493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.051049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.174296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb8068-4a24-4944-b740-f5ee90a11785 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.184866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 206/422] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:12.193165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.231023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:12.231809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.232221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.232524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.245772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:12.251879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:12.252805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:12.253664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:12.254295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 217/423] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:12.263481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.331333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10eac-4830-4318-abf2-b88c3347edef None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.335224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.387764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f01d-b60d-4ed8-91b3-23ddf32e1dba None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.393073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.414469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:12.415303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.415650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.416019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.421697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:12.423337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:12.425566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 207/424] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:12.430477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bba23-8218-4c35-959d-820af910616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:12.430804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.431554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bba23-8218-4c35-959d-820af910616f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.431991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bba23-8218-4c35-959d-820af910616f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.432472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bba23-8218-4c35-959d-820af910616f None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.433469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bba23-8218-4c35-959d-820af910616f None admin] RBAC: Adding query filter params (name=member) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:12.433947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bba23-8218-4c35-959d-820af910616f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:12.435731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bba23-8218-4c35-959d-820af910616f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:12.446858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 218/425] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:12.453124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bba23-8218-4c35-959d-820af910616f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.591704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bba23-8218-4c35-959d-820af910616f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.626272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.634406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:12.635091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.636162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.636758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.638196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ea2f-ffbb-4485-a0a7-8471da4028c1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.703590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:12.705630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.706239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.706849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.708371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:12.710148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e980888-71d8-4db9-8b23-4b0ebd0678b8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:12.712295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 208/426] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:12.713872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947abe6-92eb-4ef8-b235-bebb9bc5ffc5 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.714387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947abe6-92eb-4ef8-b235-bebb9bc5ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.714854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947abe6-92eb-4ef8-b235-bebb9bc5ffc5 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:12.716242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 209/427] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:12.720522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947abe6-92eb-4ef8-b235-bebb9bc5ffc5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:12.751011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:12.752834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698dd0-b741-430f-bba2-f0032c02d27e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:12.868132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:12.948369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947abe6-92eb-4ef8-b235-bebb9bc5ffc5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:12.981054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 219/428] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:12.982772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d51e5-e835-42f6-8cc5-8322f06a2cbd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:12.985160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d51e5-e835-42f6-8cc5-8322f06a2cbd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:12.985666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d51e5-e835-42f6-8cc5-8322f06a2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.024914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ad0d51e5-e835-42f6-8cc5-8322f06a2cbd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:13.027522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ad0d51e5-e835-42f6-8cc5-8322f06a2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:13.029696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.031854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.032959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.033433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.034815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:13.036130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:13.037847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:13.058086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 210/429] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:12 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 611 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:13.059377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.076772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.191278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 220/430] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:13.260296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcedb2-3827-4c7a-9cae-2fc5dae10b81 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:13.275924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f529b-2158-4f83-b6c4-d909b0f4e322 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.276516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f529b-2158-4f83-b6c4-d909b0f4e322 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.276516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f529b-2158-4f83-b6c4-d909b0f4e322 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.278293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 221/431] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:13.286887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.287198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.287425 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.311739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:13.313402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:13.319059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.331786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.332517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.332696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.333802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] PATH_INFO: `/v3/projects/a678c0d45a094a15b81ac4d24b3853cc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.336029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] RBAC: Authorizing `identity:get_project(project_id=a678c0d45a094a15b81ac4d24b3853cc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:13.337476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:13.339325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 211/432] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/projects/a678c0d45a094a15b81ac4d24b3853cc => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:13.348932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.405576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 222/433] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:13.479450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5c81a-4eee-4230-bf5f-4948192bbd50 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:13.514250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.514900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.515178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.515452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.516594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:13.518101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:13.520000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 212/434] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:13.525969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.574246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.664107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.689872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf939-6264-4f21-8998-dc8b1a73d591 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:13.692117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:13.728793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.729562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.729782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.730137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.730891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=a678c0d45a094a15b81ac4d24b3853cc) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:13.731193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:13.732637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:13.734933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a327ec7-55a3-4fc2-89e5-a0e42d1fe3e7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:13.739193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 223/435] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=a678c0d45a094a15b81ac4d24b3853cc&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:13.740072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.781077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.782444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.782922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.783553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.797034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:13.803352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:13.804363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 15:32:13.805627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:13.808373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 213/436] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:13.822708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.864600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733809a-3a0c-469b-bfb0-56f75e41721a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:13.914342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:13.914559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:13.914817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:13.915095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:13.944274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:13.950649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:13.951753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:13.952749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:13.959537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 224/437] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:13.963468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:13.980853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.004570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3d342-84e9-4287-95c5-23f8d701bdf5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.047608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.063591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.064560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.065276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.065769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.066719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] RBAC: Adding query filter params (name=member) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:14.067239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.068823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.080525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 214/438] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:14.088552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.120321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed042b02-28ee-473f-93b6-d4bb0c32b0bd None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.173863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59b447-1119-4145-9824-874276611794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.174833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b447-1119-4145-9824-874276611794 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.176455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b447-1119-4145-9824-874276611794 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.176969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b447-1119-4145-9824-874276611794 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.177679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b447-1119-4145-9824-874276611794 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:14.177983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b447-1119-4145-9824-874276611794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.179473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b447-1119-4145-9824-874276611794 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.193082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 225/439] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:14.195859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca66b06-8e95-4caa-9515-ff1652d4522d None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.196145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca66b06-8e95-4caa-9515-ff1652d4522d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.196421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca66b06-8e95-4caa-9515-ff1652d4522d None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.198161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 226/440] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:14.198798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca66b06-8e95-4caa-9515-ff1652d4522d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.266472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939331-212e-44c2-8df3-9629b8bc9386 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.307858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.333760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.334486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.335328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.335609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.360636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca66b06-8e95-4caa-9515-ff1652d4522d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.411605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.412225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.412498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.412767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.416421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.429908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.431917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de381b-1574-41c6-8502-fe5baad13252 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.489983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.491494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.550488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 215/441] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:14.550851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.551141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.551808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.573424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:14.574879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:14.578499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.614960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 227/442] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:14.614960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.654091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 216/443] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:14.665895 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.684923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.744356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f94813-7916-46e2-9cd2-0ae002665f22 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.779700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e478f09-c932-48ff-9ed2-749795bb076c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.786797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.787435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.787750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.789034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.790305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.792952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.795684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 228/444] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:14.800865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.822988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.823657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.823933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.824816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] PATH_INFO: `/v3/projects/2a676a719a8d4985a2c1fd2228915b06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.826195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] RBAC: Authorizing `identity:get_project(project_id=2a676a719a8d4985a2c1fd2228915b06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.828136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.833055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 217/445] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/projects/2a676a719a8d4985a2c1fd2228915b06 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:14.835868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:14.854579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.928876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11473bc4-17ec-4ecd-9b5f-dab82fe97b41 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.936530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:14.954966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dffbea-81dc-4927-a44a-0e05b22a683e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:14.967890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:14.968606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:14.968856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:14.969159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:14.970290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:14.971809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:14.977219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 229/446] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:14.977219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.000409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.001201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.001559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.001900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] PATH_INFO: `/v3/groups/a7230ce4969f4ced86e239ef4ca14324` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.003092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] RBAC: Authorizing `identity:get_group(group_id=a7230ce4969f4ced86e239ef4ca14324)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.004634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.006352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 218/447] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/groups/a7230ce4969f4ced86e239ef4ca14324 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:15.007235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.084917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599522a2-3908-492c-af11-c8b2c5d1b1e8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.095133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:15.116507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510597-1a0f-4e2b-ac09-ac1a7de5583c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.127581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.128318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.128658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.129056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.139868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:15.144587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:15.145576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:15.146386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 230/448] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:15.147096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.158116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.158728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.159000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.159266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.160001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0, scope.project.id=2a676a719a8d4985a2c1fd2228915b06) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:15.160307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.161871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.168202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 219/449] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:15.169214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.198608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:15.287085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaebe02-27d5-419f-8439-9427ce7859b2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.315030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c835-f2ed-4c36-b425-0d6a0f4a9db7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.331173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.331173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.331173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.331845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.332133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] RBAC: Adding query filter params (group.id=a7230ce4969f4ced86e239ef4ca14324, role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=2a676a719a8d4985a2c1fd2228915b06) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:15.332425 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.333925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.342451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 231/450] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/role_assignments?group.id=a7230ce4969f4ced86e239ef4ca14324&scope.project.id=2a676a719a8d4985a2c1fd2228915b06&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:15.372699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.374021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.374021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.374021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.374934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:15.377373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.377689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.389399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 220/451] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:15.396432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.442231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:15.538993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf1c-de73-447f-973c-3e61317edb3b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.580020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.580653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.581081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.581328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.664068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.665687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.699510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:15.770670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 232/452] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:15.777167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:15.858449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:15.878401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc453-0a3d-41d2-ab2e-cfc704cc0b29 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:15.912426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:15.913102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:15.913376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:15.913642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] PATH_INFO: `/v3/projects/91eb9a5b14d843409de915748f661903` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:15.914859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] RBAC: Authorizing `identity:get_project(project_id=91eb9a5b14d843409de915748f661903)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:15.916280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:15.918014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 221/453] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/projects/91eb9a5b14d843409de915748f661903 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:15.923770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:16.023890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ab51d-e6bb-4f9b-81b8-b5e9b5ecca46 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:16.052231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:16.058334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:16.058959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:16.059230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:16.059494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] PATH_INFO: `/v3/groups/aab714d35d7147ca963ffb1007402961` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:16.060593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] RBAC: Authorizing `identity:get_group(group_id=aab714d35d7147ca963ffb1007402961)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:16.062095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed6cf-16ab-4a94-898b-2367ae5591ff None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:16.063672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 233/454] 10.222.0.93 () {56 vars in 1180 bytes} [Wed Aug 24 15:32:15 2022] GET /identity/v3/groups/aab714d35d7147ca963ffb1007402961 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:16.069698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:16.172444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75749e-f2a4-44c8-9793-801aba636ecc None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:16.206528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:16.207306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:16.207765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:16.208135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:16.208876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] RBAC: Adding query filter params (group.id=aab714d35d7147ca963ffb1007402961, role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=91eb9a5b14d843409de915748f661903) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:16.209215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:16.210673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57c93e-ebdc-41bf-9e0b-3932359d8599 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:16.225085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 222/455] 10.222.0.93 () {56 vars in 1376 bytes} [Wed Aug 24 15:32:16 2022] GET /identity/v3/role_assignments?group.id=aab714d35d7147ca963ffb1007402961&scope.project.id=91eb9a5b14d843409de915748f661903&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:18.675151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc485dfc-1cfb-4647-9e7e-69cdf494edcd None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:18.675698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc485dfc-1cfb-4647-9e7e-69cdf494edcd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:18.675698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc485dfc-1cfb-4647-9e7e-69cdf494edcd None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:18.677072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 234/456] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:18.690881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72111-9360-419f-8c74-7c60e3919516 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:18.691379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72111-9360-419f-8c74-7c60e3919516 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:18.691467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b72111-9360-419f-8c74-7c60e3919516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:18.725297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-43b72111-9360-419f-8c74-7c60e3919516 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:18.725297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-43b72111-9360-419f-8c74-7c60e3919516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:18.739106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:18.834808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 223/457] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:19.146848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc25d9-c2bd-4c4f-81cc-52eb812e8dd3 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.147122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc25d9-c2bd-4c4f-81cc-52eb812e8dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.147387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc25d9-c2bd-4c4f-81cc-52eb812e8dd3 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.149110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 235/458] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:19.156952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c232-af0a-4305-9e12-7428bf06ba59 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.156952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c232-af0a-4305-9e12-7428bf06ba59 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.156952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c232-af0a-4305-9e12-7428bf06ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.175349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc25d9-c2bd-4c4f-81cc-52eb812e8dd3 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:19.178474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6af5c232-af0a-4305-9e12-7428bf06ba59 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:19.181730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6af5c232-af0a-4305-9e12-7428bf06ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:19.289893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 224/459] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:19.293077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf12d-c3a2-4310-a6cc-157e644f979d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.293362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf12d-c3a2-4310-a6cc-157e644f979d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.295606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bf12d-c3a2-4310-a6cc-157e644f979d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.296989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 225/460] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:19.310590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.310863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.312052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.342275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc25d9-c2bd-4c4f-81cc-52eb812e8dd3 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:19.356134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:19.356134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:19.396796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:19.397898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.398717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.399171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.420423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:19.422275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:19.441623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:19.442594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:19.443895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:19.443895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:19.443895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:19.443895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 236/461] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:19.465989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:19.548317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 226/462] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:19.578421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:19.627809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:19.639047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:19.677022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2644b48-0778-461a-a87b-0d899181d456 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:19.777763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d0db-87d1-4829-94f7-5ce224aa3dde None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:19.790699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:19.791845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.792315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.792770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.795209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:19.795741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:19.798536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7989c-c4e5-4b7d-ae97-0a7c0174189e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:19.821973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 237/463] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:19.823060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:19.823806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.824869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.824869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.825804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6221-b4ec-43b5-8030-c7ecc2e7302b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.826167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6221-b4ec-43b5-8030-c7ecc2e7302b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.826332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6221-b4ec-43b5-8030-c7ecc2e7302b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.839274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 238/464] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:19 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:19.840516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d6221-b4ec-43b5-8030-c7ecc2e7302b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:19.846577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:19.848120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-486851a0-56d7-47b1-8396-116110cd3dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:19.884090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:19.885419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:19.886300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:19.886300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:19.886300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:19.891158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 227/465] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:19.891158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:19.891158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:19.891158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:19.914414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:19.915606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:19.980110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:19.995546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d6221-b4ec-43b5-8030-c7ecc2e7302b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.002847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 228/466] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:20.003703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.011201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.047530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.048526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.049257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.049740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.050593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.052771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.081154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 239/467] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:19 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:20.081154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.193100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e70da-24f7-4aea-9e54-780d422521bc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.266898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.267557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.272926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.272926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.272926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:20.272926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.272926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.304929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 229/468] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:20.308924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.320141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc7e85-efb1-41f3-9b4a-47fea689d5d0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.373941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.384546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.385276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.385616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.385891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.403480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.405515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:20.422368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:20.423345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:20.424201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:20.424201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:20.424201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:20.426051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 240/469] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:20.427106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.452061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d97193-d0bd-40fa-9867-86ce464a4364 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.456342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.514468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.515572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.517144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.517585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.518674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.521488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.552933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 230/470] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:20 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:32:20.553625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.584430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1bed-d3f8-4ca1-b63f-7bee0a908ac7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.637536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.638702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.640189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.640614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.654801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.656443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-6ae45d5b-3553-4304-b9cf-c6d978b532d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:20.674458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:20.675644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:20.676732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:20.676732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:20.676732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:20.683318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 241/471] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:20.685292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173cc2-25c8-49e4-b60e-18f30ce3ed88 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.685292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173cc2-25c8-49e4-b60e-18f30ce3ed88 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.685997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46173cc2-25c8-49e4-b60e-18f30ce3ed88 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.692218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 242/472] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:20.693397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46173cc2-25c8-49e4-b60e-18f30ce3ed88 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.697028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.703770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d126b-cfee-4b3d-8587-90695c93f9c0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.757860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.759013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.760326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.760658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.761381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:20.761711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.763083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43d5f3-6784-4717-89f7-7ed020c850e2 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.779995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 231/473] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:20.782323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.782812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.783275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.812182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:20.812182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:20.813058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.860033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46173cc2-25c8-49e4-b60e-18f30ce3ed88 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:20.905155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:20.906220 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:20.906567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:20.906835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:20.907761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:20.908063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:20.909845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:20.915469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 232/474] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:20.921641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:20.923406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 243/475] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:20.935933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:21.123814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:21.134413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3f0f1-9b9e-4a19-8731-6bb6aeda67c2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:21.140276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f0409-fa26-4b71-9784-bcaea0acbb67 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:21.193760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:21.202897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:21.203641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:21.203916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:21.204185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:21.204844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:21.209986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:21.228093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:21.228721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:21.229015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:21.229390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:21.230101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:21.231555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:21.263209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 244/476] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:20 2022] POST /identity/v3/users => generated 249 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:21.268952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:21.292995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 233/477] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:20 2022] POST /identity/v3/users => generated 248 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:21.466042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30c151-704b-48b8-8035-9f379e0a8c8a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:21.510822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:21.511406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:21.511682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:21.511949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:21.512651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:21.514134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:21.534117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.sql.core [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:32:21.534117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 15:32:21.534117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [parameters: {'id': '6e0cd82e73684055a5c34b86a50af995', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 15:32:21.534117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88172) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application result.read() Aug 24 15:32:21.551063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:32:21.552046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application yield resource Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise self.value Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application session.commit() Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:32:21.553392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:32:21.554273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:32:21.555212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application result.read() Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:32:21.556038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [parameters: {'id': '6e0cd82e73684055a5c34b86a50af995', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:21.556850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 15:32:21.559911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:21.563686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 245/478] 10.222.0.93 () {60 vars in 1131 bytes} [Wed Aug 24 15:32:21 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:21.563824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:21.681411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c315b-1761-4509-b608-079c53818b05 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:21.721044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:21.721587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:21.722268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:21.722268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:21.734529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-73fe9563-6f1d-40ed-b1c5-86692edcc0cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:21.739987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:21.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:21.741811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 234/479] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:32:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:21.748115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:21.804140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:21.860929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451930c7-7f56-432f-b81d-1a01cbebda52 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:21.896359 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:21.897100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:21.899517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:21.899517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:21.899517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:21.899517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:21.900307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9da6a-59a1-4bb9-bd40-4b214615e942 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:21.909983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 246/480] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:22.970809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9ac1-a2b8-4fde-8f6e-e81e7b57379a None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:22.971334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9ac1-a2b8-4fde-8f6e-e81e7b57379a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:22.971334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9ac1-a2b8-4fde-8f6e-e81e7b57379a None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:22.973066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 235/481] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:22.979293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b55e-fd0b-4066-ad5f-16209fecedc6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:22.979293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b55e-fd0b-4066-ad5f-16209fecedc6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:22.979293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246b55e-fd0b-4066-ad5f-16209fecedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:23.018162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a246b55e-fd0b-4066-ad5f-16209fecedc6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:23.019699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a246b55e-fd0b-4066-ad5f-16209fecedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:23.167498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 247/482] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:23.257217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477429d-f165-4ded-97c7-20eb1387a4d5 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:23.257534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477429d-f165-4ded-97c7-20eb1387a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:23.257744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477429d-f165-4ded-97c7-20eb1387a4d5 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:23.260321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 236/483] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:23.264800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:23.265127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:23.265403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:23.283777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:23.284968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:23.320254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:23.367913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 248/484] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:23.488054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477429d-f165-4ded-97c7-20eb1387a4d5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:23.498766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:23.600776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477429d-f165-4ded-97c7-20eb1387a4d5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:23.638480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:23.639128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:23.639400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:23.639669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:23.656260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:23.660977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:23.661877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:23.662687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 237/485] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:23.670280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:23.706319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:23.789311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:23.825221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8e30-8132-46bb-8915-bb9b865d6059 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:23.862497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:23.863068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:23.863343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:23.863608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:23.875222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:23.880593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:23.881526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:23.882342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 238/486] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:23.888773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:23.919212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc1f12-71f0-4015-affd-0480e3cd109f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:23.995825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e276-4fba-41b4-a4d2-f1c43ba4de39 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.025308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.034335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.034823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.034963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.035237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.035441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.035542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.035884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.036160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:24.036325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.036454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.037208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:24.037609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.037850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.039549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.049005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 239/487] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:24.054687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.056247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 249/488] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:24.065957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.125575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.161381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6fd79-f206-47a8-8fc9-09e9f1f12366 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.197111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.198184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.198661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.199129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.202553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b3c81-dcd0-4cac-b3c6-0f547268b6ec None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.216138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.220852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f477aa7e-193e-4752-837d-634fd146cafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:24.237584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:24.238507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:24.239380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:24.239380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:24.239380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:24.239545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.239545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.239545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.239545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.246652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 240/489] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:24.249938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73640807-dd7e-4f30-a08e-960688341fd5 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.250569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73640807-dd7e-4f30-a08e-960688341fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.251078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73640807-dd7e-4f30-a08e-960688341fd5 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.252915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 241/490] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:24.253849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73640807-dd7e-4f30-a08e-960688341fd5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.259843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.262462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-5736f2e9-321d-4bc7-b82b-00dbf8b8477a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:24.281971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:24.283775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:24.285554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:24.285554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:24.285554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:24.285554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 250/491] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:24.285967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.287048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.287048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.316757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:24.318003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:24.324845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.403569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73640807-dd7e-4f30-a08e-960688341fd5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.421407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 251/492] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:24.421407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.448770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.451200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.451659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.452099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.452965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:24.454315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.456004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d8812-0fa5-4b87-80c6-666ea69af932 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.464938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.479437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 242/493] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:24.486651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfe13-dcec-4976-a470-71ad89c844bb None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.486938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfe13-dcec-4976-a470-71ad89c844bb None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.487203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfe13-dcec-4976-a470-71ad89c844bb None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.492491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 243/494] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:24.492491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfe13-dcec-4976-a470-71ad89c844bb None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.633684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50cc89-1cf3-43b7-a3e7-3371ea7d7844 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.658455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.663243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfe13-dcec-4976-a470-71ad89c844bb None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.669282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.669900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.670181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.670449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.671100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:24.671397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.672775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890970e8-b53c-4013-a276-91ad3716a220 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.684954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 252/495] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:24.686274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.686612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.686889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.699624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.700264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.700530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.700791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.705263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:24.706448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:24.708356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.709855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:24.722683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:24.723608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:24.724529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 244/496] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:24.726103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.775790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 253/497] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:24.776685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.784434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.822899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528921-3d7d-4c4a-9763-32afcf60c036 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.856622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.857279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.857555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.857826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.865379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:24.866853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:24.875837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46f67f-acc3-4f9b-8b65-90439b365d75 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-bf5a2a5c-b916-4580-bce9-ca3c8e3ce023 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:24.877710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:24.878772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:24.879844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 245/498] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:24.880399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851e28-06c1-41f8-8f56-3ba7abf689de None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.880464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851e28-06c1-41f8-8f56-3ba7abf689de None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.880731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851e28-06c1-41f8-8f56-3ba7abf689de None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.884939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 246/499] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:24.884939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851e28-06c1-41f8-8f56-3ba7abf689de None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.906592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:24.919892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:24.920485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:24.920757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:24.921051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:24.931412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:24.936227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:24.937153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:24.938134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 254/500] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:24.938791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:24.991597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851e28-06c1-41f8-8f56-3ba7abf689de None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.008666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.028017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.028640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.028927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.029201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.029968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:25.030308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.031866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a30c5f-d87e-477c-9d26-88e591a59dbb None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.047712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f16dd-5fb9-44c2-8bd8-95aa793940e9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.068271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 247/501] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:25.069526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.070018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.070134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.080928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.081577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.081851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.082114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.082841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:25.083142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.084575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.087628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:25.088851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:25.120724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 255/502] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:25.121607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.157022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 248/503] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:25.158264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.168546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.242612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959cb0-6871-4c2d-8d30-1bd694b041b0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.267094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662abf7-0352-401f-b60c-1d3c57db81c5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.268861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.281496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.282207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.282510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.282778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.283443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:25.283725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.285260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.298306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 256/504] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:25.298306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.308411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.309100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.309373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.309637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.320507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:25.325295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:25.326245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:25.327050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 249/505] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:25.327718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.396048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.406857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b191-faee-4941-a631-cf944fe42a48 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.431513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641450b-7f03-40cd-aea8-065f139791a6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.440384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.441026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.441302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.441568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.464470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.465105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.465379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.465648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.493449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.507621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.509129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.534277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.535794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.601907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.608309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 257/506] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:25.609175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.639095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 250/507] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:25.640006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.694203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.709351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86473f5a-470e-4b9f-9f06-018eb8250bf1 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.734942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5269a1-e9ce-4e4f-a0ba-01609b4b8bfd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.743809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.744381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.744678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.744973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.755150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.756608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.767788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.768392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.768664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.768955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.769641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:25.769935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:25.770787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:25.771641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:25.772770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:25.772770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.772770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:25.773491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.773587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 258/508] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:25.773587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.784798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 251/509] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:25.785648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.815994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.880172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457602db-25f4-417d-94ac-b30b1f304992 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.888454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e05964-fa14-4847-99e6-67bd5f7c02bb None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:25.913544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.914176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.914455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.914734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.922166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:25.922972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:25.923599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:25.923989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:25.924256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:25.926285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.927734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.934639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:25.936086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:25.941461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:25.942353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:25.943205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:25.943205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.943205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:25.943205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 259/510] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:25.943422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:25.953537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:25.954495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:25.955348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:25.955348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:25.955348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:25.955348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 252/511] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:25.955574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.036110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.047333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c113dbc-2098-424b-9161-7440a0ac4bf3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.055436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aff2f-26a7-4e94-aa45-afcb5bb7806e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.081443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.082068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.082338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.082603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.089355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.089954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.090222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.090486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.091120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.091540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.092945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.093346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.094834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.104927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 253/512] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.105726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:26.108683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:26.109850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:26.110744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:26.110744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:26.110744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:26.110744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 260/513] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:26.110744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.158989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.210141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78e56-d197-4fee-8813-bc3b038e592b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.219855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8a263-105d-475c-bbf2-8ed0d3c60b7c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.245427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.246144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.246414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.246680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.252434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.253080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.253355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.253617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.254249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.254540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.255925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.256446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.257906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.259571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.268404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 261/514] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.269252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:26.273483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:26.274353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:26.275191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:26.275191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:26.275191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:26.275191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 254/515] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:26.275400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.371694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf45e9-fe37-4781-882b-d4aa8edbdb21 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.372778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0376ae-6de2-4557-abc8-dffed0596c57 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.373185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.406339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.406967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.407240 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.407511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.409094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.409702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.409968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.410221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.410848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.411142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.412540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.415079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.416564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.423973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 262/516] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.424782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:26.427572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:26.428994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 255/517] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:26.430127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.485260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.531395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b44597-32b8-4756-aa28-d27d152edda3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.532848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf6974-2ec7-4d8c-a46e-e3056e3e8e67 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.564192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.564819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.565115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.565383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.566015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.566309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.566940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.567542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.567685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.567777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.568055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.568661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.570122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.579017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 263/518] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.579796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.592674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 256/519] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:26 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:26.593382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.608613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.696937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f186d25-cdcf-4b3a-aa40-febb25302f6b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.720543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2e20-4503-45aa-a08a-783ebad6fa7f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.732092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.739192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.740045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.740461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.740740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.741574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.741881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.743588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.757514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 264/520] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.758632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.764859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.765642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.765915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.766183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.774879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.776432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:26.788684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:26.789687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:26.790523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 257/521] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:26.790998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.850524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:26.868986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c0a81-6a5e-45ee-9a74-99f1edbdffc6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.895998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a3251-6d55-44ac-9155-0eb2b89bc4b6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:26.902094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.902708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.902981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.903247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.903972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:26.904277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.905745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.922769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 265/522] 10.222.0.93 () {56 vars in 1139 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:26.923596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:26.936742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:26.937651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:26.938063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:26.938466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:26.946183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:26.948013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:26.960441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:26.961470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:26.962496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:26.968857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 258/523] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:26.970102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.000999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.028197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92764140-2e13-42fb-943a-68c0e1092d3e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.063967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.064667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.064967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.065233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.073252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.074718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.075788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee30aa-05ae-4a74-97c8-1812a1cfb5cd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.077506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:27.089883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:27.091325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 266/524] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:27.092253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.120354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.120999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.121291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.121546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.122288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:27.122663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.124309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.142872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 259/525] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:27.148767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.202469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d29589-c80c-4a8f-bfb3-ccdf82d049be None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.240034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.240654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.240953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.241231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.246281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.256650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bf878-cb64-4af9-b96d-65aa4c7d134e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.291898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.292649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.293022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.293378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.294141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:27.294503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.296010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.309226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 260/526] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:27.311882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.315035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.315519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.317345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.417396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb21d0a-949f-463f-b601-4c09b00651e1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.419737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 267/527] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:27.420624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.458893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.459523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.459858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.460187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.461014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:27.461375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.462901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.480406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 261/528] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:27.481200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.493698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.525829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.529600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99415046-1ed4-4d13-bf4f-8f3b486cb3ae None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.567909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.568525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.569187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.569461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.570503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=284f6ac815d940ccb5f3dc7755bc201e) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:27.570813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.573089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.578218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 268/529] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/role_assignments?user.id=284f6ac815d940ccb5f3dc7755bc201e&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:27.586132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.600399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e39d8-951f-4dab-942e-70e2c12695af None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.643681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.644317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.644651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.644961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.645774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:27.646089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.647612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.660936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 262/530] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:27.660936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.771713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd92a6-f12c-4204-a131-d3b1d82f55c3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.794982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.816711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.819016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.819016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.819016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.832342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.834505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:27.852349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dc5a7-ed13-4ba0-9be7-45444f113818 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:27.853150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:27.854119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:27.855036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:27.855036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:27.855036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:27.855036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 269/531] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:27.860111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:27.887427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.895985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:27.896995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:27.897486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:27.897996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:27.975770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:27.977725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.000411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb7ea-3ddf-4309-a611-951c78eee70e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.048515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.050228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.053283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.054707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.056509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:28.057231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.060096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.062121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.086297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 270/532] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:28.092050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.112613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 263/533] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:28.119076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.237287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.274889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1714f05-772d-4a07-b185-53281278e2e7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.302865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922df969-ab8d-4c8a-a323-c07ee3c9532a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.316769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.316769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.316769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.316769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.328181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.332376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:28.355954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:28.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:28.357812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:28.360560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 271/534] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:28.366721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.371390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.372295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.372780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.373262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.384188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.386202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:28.402496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:28.403445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:28.404288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:28.404288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:28.404288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:28.406472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 264/535] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:28.412319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.439014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.520414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61360cc-f5d7-495b-b2e4-9682f9bb2b82 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.590750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68d0f0-c2a2-4e1b-9d31-b277c7b47d18 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.593543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.594424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.594892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.595358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.596196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:28.597627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.600213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bed06-12e7-439e-8bce-9230a298c988 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.625977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 265/536] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:28.627289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598cc-fab1-4760-9e5c-81e0a57df745 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.628945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598cc-fab1-4760-9e5c-81e0a57df745 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.628945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66598cc-fab1-4760-9e5c-81e0a57df745 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.629385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 266/537] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:28.633882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66598cc-fab1-4760-9e5c-81e0a57df745 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.650389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.651157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.651491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.651821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.652671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:28.653083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.654713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eead1de-5b68-43e8-a599-0419ed0abe90 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.659055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.675083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 272/538] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:28.676462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.676749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.677046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.695965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:28.697211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:28.720519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.737335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66598cc-fab1-4760-9e5c-81e0a57df745 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.769416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 273/539] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:28.770508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.781627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.782287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.782570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.782843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.795902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.797452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:28.820336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:28.821451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:28.822456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:28.829889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 267/540] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:28.836857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:28.880727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb344c3-4bbe-49fb-8b01-c68dbbe1276b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:28.909284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:28.918459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:28.919390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:28.919846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:28.920334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:28.921295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a6987a8308864fb599f4a2a2ecfa226a) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:28.921791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:28.923676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:28.930939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 274/541] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/role_assignments?user.id=a6987a8308864fb599f4a2a2ecfa226a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:29.038122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca801df-c503-47fa-abb5-8801a87a80a7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.085651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.086324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.086604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.086875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.087578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:29.087889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:29.089438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:29.109003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 268/542] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:29.114796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:29.127080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:29.133269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:29.272970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edbe44-fc0c-49eb-bf52-4084b02484a3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.319634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.320252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.320543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.320804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.325115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=8620b3bc47e241b18a60bd7f43fd4f57) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:29.325431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:29.326918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:29.332839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d4c3d-e952-4a67-a055-755499b44548 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.344717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 275/543] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:29 2022] GET /identity/v3/role_assignments?user.id=8620b3bc47e241b18a60bd7f43fd4f57&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:29.375508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.376166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.376443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.376756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.389182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:29.394111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:29.395039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:29.396272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 269/544] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:29.402035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:29.470904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:29.532335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb358f1-de35-47a7-892b-16d87147e456 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.583857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.584867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.585357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.585833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.586684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:29.587203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:29.594318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:29.604079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 276/545] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:29.609404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:29.703874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:29.743713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4de98-f856-4c7f-a226-f4d850c1b578 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.779057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.779698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.779971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.780237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.790923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:29.792570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f7cf8815-a6ef-4a03-bdb7-bd2a2af35826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:29.807730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:29.808661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:29.809962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:29.809962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:29.809962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:29.809962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 270/546] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:29.815204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:29.937917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1fe24-6948-4242-9ebf-90cd703215de None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:29.964456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:29.974690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d5a8-e310-480b-be24-9437723fd2c8 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.974992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d5a8-e310-480b-be24-9437723fd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.975235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732d5a8-e310-480b-be24-9437723fd2c8 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.976744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 271/547] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:29.982759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.982759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.982759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.988426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:29.989075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:29.989354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:29.989625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:29.990267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:29.990743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:29.993028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:30.003027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:30.004503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:30.006282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 277/548] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:30.016932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.130119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f11266-0910-4a28-b009-48b8ee4367ec None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.168361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.169177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.169497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.169770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.182316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:30.183830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:30.187985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 272/549] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-9f5b91bf-664a-4760-b554-2ee4455e3550 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:30.199409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:30.200335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:30.202006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 278/550] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:30.206354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.238361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01c61-9371-43b8-a150-07a480e57552 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.238681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01c61-9371-43b8-a150-07a480e57552 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.238892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc01c61-9371-43b8-a150-07a480e57552 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.244991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 279/551] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:30.250101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.250375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.250643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.258601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.281933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:30.283137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:30.315121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bc306-0dea-4e01-9f13-348af5440cae None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.332936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.352270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.352909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.353209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.353477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.354281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:30.354586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:30.356143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:30.374467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 273/552] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:30.380115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.403226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 280/553] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:30.483252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a257-4f88-4f71-a584-425fc9206f90 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.485658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.520835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.521519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.521814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.522089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.592648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:30.594153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:30.640676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.710923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 274/554] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:30.716936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.722784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.760423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92cc8e-22e6-4e1d-a263-588bd97daa8c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.796980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.797987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.798484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.798944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.810034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:30.815196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:30.816242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:30.817140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:30.819276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 281/555] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:30.820272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.853578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.858896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99151aac-662c-4953-9d93-dcda7fb210e3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.894399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.895070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.895299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.895571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.906764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:30.908251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:30.923974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:30.924992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:30.925983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:30.925983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:30.925983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:30.925983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 275/556] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:30.926648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:30.931644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7771dd3-eb7b-4c82-ada9-87d710a82053 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:30.967185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:30.968192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:30.968644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:30.969109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:30.979895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:30.984805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:30.985742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:30.987093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:30.987737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:30.989722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 282/557] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:30.990783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.038611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f27cc8-cc19-40da-96d2-445b3b6cfe42 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.075214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.075955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.076228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.076600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.077373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.077743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.079210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.080456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.094097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 276/558] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.094097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.100205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d46bb-6cb7-444b-bc72-3de06eca637a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.136526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.138007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.138502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.138959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.139780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.140269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.141984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.154983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 283/559] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.155923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.208611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2d5b-93dc-4088-b081-615e797a2067 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.228186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.246990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.247607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.247879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.248143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.248808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.249131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.250641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfa26-c47c-4fb2-86f7-1ef7ccd1ded6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 277/560] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc321-f9cd-46ed-b1ab-54d525096d0c None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc321-f9cd-46ed-b1ab-54d525096d0c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc321-f9cd-46ed-b1ab-54d525096d0c None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 278/561] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:31.265868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc321-f9cd-46ed-b1ab-54d525096d0c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.272427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a242a6-d50b-4cf3-a7fe-db50845a4534 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.308839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.309430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.309765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.310040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.322247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.323714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.330950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:31.340579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:31.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:31.342970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:31.342970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:31.342970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:31.344453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 284/562] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:31.345422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.387192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc321-f9cd-46ed-b1ab-54d525096d0c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.422342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.422991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.423264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.423560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.430482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.431966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7b127869-8f85-4f71-a38d-931125f9ba1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:31.443116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:31.444148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 279/563] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:31.445492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.446075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.446075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.461414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baddca2-aa7a-4249-a949-e295f4d851d1 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.464545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:31.465748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:31.498416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.499057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.499330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.499598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.501448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.512693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.514202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:31.529156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:31.530164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:31.531054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:31.531054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:31.531054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:31.531054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 285/564] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:31.531054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.541505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 280/565] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:31.542338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.586291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.639344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0afef-5f24-49df-8670-d2fdcbfa79ad None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.653139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec241dfb-98b0-4891-b549-f27799cbf6d2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.675518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.676139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.676387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.676649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.677305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.677598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.678966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44de50d-b816-4f78-9066-5c5021a4b2a8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.688350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.688995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.689271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.689536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.690234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.690536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.691821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 286/566] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.692169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.694539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0149d-d0f6-469e-98af-d74b4fe733a9 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.695506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0149d-d0f6-469e-98af-d74b4fe733a9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.695977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0149d-d0f6-469e-98af-d74b4fe733a9 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.697591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 287/567] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:31.698676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0149d-d0f6-469e-98af-d74b4fe733a9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.705854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 281/568] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.706809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.742061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.806021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0149d-d0f6-469e-98af-d74b4fe733a9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.816305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82526d-cf7f-4a2a-9639-29c1096ec7d5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:31.816951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.840154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.840685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.840982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.841252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.841880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:31.842179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.843540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b744e0e-2305-4052-a96e-f47bf3a50cc6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.849216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:31.849843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.850114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.850382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.854967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 288/569] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:31.856230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:31.856580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:31.856942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:31.857839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:31.859272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:31.870662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:31.871787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 282/570] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:31.872747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.877677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:31.878865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:31.943570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 289/571] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:31.944394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:31.963877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:31.973461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b9764-39ca-4568-993a-8fcfb76f5603 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.011282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.012587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.013306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.013747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.015063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=21dcdde810504ecf963f7b4abc93270c) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.015766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.017761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.028730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 283/572] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/role_assignments?user.id=21dcdde810504ecf963f7b4abc93270c&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:32.029758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.070841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.074532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8c39e-2ed1-4e91-8883-d210b77ff25b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.114816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.115475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.115820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.116160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.130090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:32.135464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.136445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:32.138224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 290/573] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.142325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.152491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f42a-2626-41a5-8d66-d7a1b1244508 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.190819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.192091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.192541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.193022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.201847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.203747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:32.224585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.225988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 284/574] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.226933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.244390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.262591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338b49b-1272-4526-8b55-d5143dee7db3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.299415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.299999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.300272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.301235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.301347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.301576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.303018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.321403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 291/575] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:32.326674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.331668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7a930-5426-4325-b809-d206d63d0432 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.346250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.368986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.370303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.370750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.371058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.372047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.372346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.374067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.382607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 285/576] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:32.383445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.434366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cc47d-5811-4967-a569-86d0f4b43348 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.465274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.469821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.470575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.470848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.471116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.481382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:32.486011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.486960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:32.487825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:32.489762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4a4e1-9f90-44da-9c98-df8be1e2570b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.492076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 292/577] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.492950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.526800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.527422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.527701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.527969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.528704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.529041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.530497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.548346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 286/578] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:32.549022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.581954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.605791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc650b2f-6fa5-41f5-8b32-b741a1f22034 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.641814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.642379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.642684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.642903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.649606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44f0d2-0343-43e8-baf7-b0558e4b0dd9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.653793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.655238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:32.670123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.671292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:32.672190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:32.672190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.672190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:32.672190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 293/579] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.672190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.690990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.691725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.691912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.692188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.694175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.703128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.704629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:32.720424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.721676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:32.722585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:32.722585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.722585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:32.722585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 287/580] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.723027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.786219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39f98-b0ed-4650-b45e-55e418c2e89a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.816956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.823733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.824341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.824446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339296-0886-476d-9b67-142e5ce4baff None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.824607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.824876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.825591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.825892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.827246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.840940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 294/581] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:32.840940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.862941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.863579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.863848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.864120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.876053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.877690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:32.893421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:32.894385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:32.895298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:32.895298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:32.895298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:32.895298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 288/582] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:32.895298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:32.938304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:32.955230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d33f-0d08-4355-ab4f-9c06eec57fb7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:32.990540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:32.991065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:32.991418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:32.991688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:32.992325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:32.992618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:32.994026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.001551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d454a2d-8fb2-42c0-b705-b8f171e972b7 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.006962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 295/583] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.007793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.040881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.041833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.042103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.042375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.043021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.043324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.044717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.057636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 289/584] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.058459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.066788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.117917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf46edf-7fa5-44e2-bb6b-b1f49f8b1861 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.155612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.156279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.156551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.156826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.162020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.166921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855747-eecc-4885-9fa0-e0470171a431 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.168156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.169650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:33.184055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:33.185153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:33.186177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:33.186177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:33.186177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:33.189996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 296/585] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:33.190826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.210224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.211052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.211470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.211881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.212671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.213225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.214618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.228802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 290/586] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.229715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.303064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2dc9-589b-415e-b590-6e266ee7d20b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.305879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.335233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38989f5-4f7d-4439-aae4-bea9c48ad7f5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.341703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.342864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.343105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.343408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.350951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.352392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:33.364256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:33.365222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 297/587] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:33.366131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.378154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.378794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.379143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.379333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.387638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.389110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:33.400620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:33.401892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:33.402823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 291/588] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:33.403417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.422824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.478756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7769d-bc77-4284-b80d-39459f0c408f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.505829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cb141-32ce-46bd-bea6-edc7b335058e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.514813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.515443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.515734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.516196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.517147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.517430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.518845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.532110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 298/589] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.533117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.545823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.546744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.547025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.547290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.554678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.556166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.559407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:33.568214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:33.569134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 292/590] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:33.575573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.641201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057bc8e-6799-4496-8f52-9ab9d0073a71 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.654667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.677807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e55c94-9431-4fae-8aa8-1636fe75a85d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.677989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.678508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.678867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.679205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.679970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.680338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.681890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.693736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 299/591] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.694562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.718942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.719561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.719838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.720106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.720832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.721174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.722631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.741161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 293/592] 10.222.0.93 () {56 vars in 1139 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.745174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.790637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.808876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7df09a-c492-40f3-9fd2-35295b7d5455 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.844850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.845520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.845795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.846068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.846204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde074d-2e96-4189-8707-b6d205c892b9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:33.854295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.855754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:33.869134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:33.870092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 300/593] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:33.871069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.886702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:33.887292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:33.887564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:33.887829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:33.888519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:33.888815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:33.890353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:33.892821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:33.907555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 294/594] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:33.907555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:33.977579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e4230-3665-4e89-a5cd-9887e4d35e15 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc719d-81da-452f-bd51-f5413aea897b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.009824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.010537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.010808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.011080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/284f6ac815d940ccb5f3dc7755bc201e/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.025758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=284f6ac815d940ccb5f3dc7755bc201e, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.027204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.029440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.034918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.035555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.035826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.036092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.041449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 301/595] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:33 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/284f6ac815d940ccb5f3dc7755bc201e/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:34.042296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.063873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.065475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:34.081419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:34.082478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:34.083362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:34.083362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:34.083362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:34.083362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 295/596] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:34.083362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.140866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.163217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca5262-78ee-455d-acd6-30ce9bb5c1d7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.204062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569497d-a4da-4bf3-a7fa-9ef318b090be None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.204606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.205257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.205536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.205805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.206656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:34.207092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.208550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01ff68-5cad-474a-ab99-b24ca0c464ab None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.228514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 302/597] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:34.230422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fad408-550d-4dcc-a199-8fecb23a4c5c None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.230780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fad408-550d-4dcc-a199-8fecb23a4c5c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.231251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fad408-550d-4dcc-a199-8fecb23a4c5c None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.233035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 303/598] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:34.237055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fad408-550d-4dcc-a199-8fecb23a4c5c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.248773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.250026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.250475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.250746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.265529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=79b6528e8e264539aae69a23f7e2b4e0, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.266976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.288943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 296/599] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:34 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:34.288943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.299756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.359624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fad408-550d-4dcc-a199-8fecb23a4c5c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.409253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.409480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.409879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.410310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.410592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.411576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:34.412013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.413594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff4af-bf41-4554-ba82-c46d5a072216 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.414182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7639-9bea-483f-b3bc-3aab1bc8a62c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.430369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 304/600] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:34.432117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.432470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.432850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.457642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:34.458972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:34.459862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.460713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.461412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.462267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.477417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.479912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:34.499284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:34.500305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:34.501705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:34.501705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:34.501705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:34.501705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 297/601] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:34.501705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.554586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 305/602] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:34.561104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.637391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.659613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d707d-d6f8-4cdc-918c-cef40996b8aa None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.719773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.720416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.720692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.720987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.738415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.741172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.753246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31f9d-47b0-4479-8229-c63d266eafa6 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:34.762441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:34.763340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:34.764271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:34.770563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 298/603] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:34.776074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.797639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.798382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.799347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.799632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.799904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.800603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:34.800933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.802431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.815641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 306/604] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:34.823957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.928865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0f91b-e320-469d-bcd8-78050504cdc3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.960264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cabcd3-36d4-43ea-a2fd-7d72787dca17 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:34.962479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:34.965915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:34.966727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:34.967140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:34.967546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:34.968430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:34.968924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:34.971417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:34.985197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 299/605] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:34.986528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:34.999313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.000567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.001048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.001725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.011330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.013595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:35.029328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:35.030458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:35.031560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:35.035443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 307/606] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:35.036324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.089343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.099167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e461e4-1715-4d55-b973-ad451433ec1b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.135699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.136783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.137257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.137739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.142170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4d45-44fa-4414-b1bb-fc5a02041ff9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.149283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:35.154550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:35.155607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:35.156444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:35.163806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 300/607] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:35.165081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.178203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.178897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.179174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.179447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a6987a8308864fb599f4a2a2ecfa226a/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.195711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=a6987a8308864fb599f4a2a2ecfa226a, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.197283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.217879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 308/608] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:35 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a6987a8308864fb599f4a2a2ecfa226a/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:35.226130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.251807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.304180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff884d-37da-429a-a893-fa34c6eb2889 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.349290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeed705-1c0e-4803-b669-63bf75feb972 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.361159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.378738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.379423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.379704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.379973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.380684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:35.381008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.382514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.391209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.392234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.397072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.397602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.398860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:35.399313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.401506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.414684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 309/609] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:35.419101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 301/610] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:35.420227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.434827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.507103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.538605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b60e2d-493f-45e9-9a31-30dcd0bb40bb None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.576307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.577523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.577954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.578497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.592304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.594782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.599612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e374df-4bef-4431-bd6d-f9d3c8c2e838 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:35.613281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:35.614479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:35.615578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:35.615578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:35.615578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:35.617949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 310/611] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:35.623391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.644750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.645770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.646247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.646691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/8620b3bc47e241b18a60bd7f43fd4f57/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.662695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=8620b3bc47e241b18a60bd7f43fd4f57, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.664505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.682787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 302/612] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:35 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/8620b3bc47e241b18a60bd7f43fd4f57/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:32:35.767247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73bfc-e26f-47ee-a69f-d81c19e1e4e1 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.807236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.822436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.823119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.823392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.823665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:35.824320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:35.824626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:35.826031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:35.839602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 311/613] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:35.845285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:35.892411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:35.955896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eedd50-3345-479e-b3ec-57f9eb3883a3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:35.993324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:35.994412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:35.994889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:35.995353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.003748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.005630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-dfb26b07-93ce-49cf-b5b5-34e83c97b15c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:36.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:36.019447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:36.020404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:36.023022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 303/614] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:36.029566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.095296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6d48-bbb3-4b86-841c-c12b91aee340 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.095636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6d48-bbb3-4b86-841c-c12b91aee340 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.095839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a6d48-bbb3-4b86-841c-c12b91aee340 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.097593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 304/615] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:36.112845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.113292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.113663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.138082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:36.140564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:36.145699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef02e1-f5b0-4502-912e-3ca76a6baeb0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.183762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.185225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.185677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.186133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.187051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:36.187577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.189323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.228946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 305/616] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:36.243174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 312/617] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:36.250498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.302416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:36.380391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0369-1c53-4d3f-bbe6-56f6e77a16e4 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.416690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.417437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.417711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.417978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.428573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.430142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-c7676396-2b1f-4f49-8b87-9ad05861d7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:36.445395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:36.446476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:36.448140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:36.448140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:36.448140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:36.448140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 306/618] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:36.453446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.470763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5eaeb-f484-4992-af92-889b83a6eb9c None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.471106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5eaeb-f484-4992-af92-889b83a6eb9c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.471310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5eaeb-f484-4992-af92-889b83a6eb9c None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.472621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 307/619] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:36.477710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.477989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.478260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.497576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:36.499044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:36.568972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:36.574042 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 308/620] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:36.575027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.589733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:36.640446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7125-d14e-4a4b-ab1a-30d82e2c266e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.676352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.677360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.677854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.678336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.679227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:36.679762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.681344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.688178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45743ca-08c1-4308-a437-8e6bcda68ca9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.694160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 313/621] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:36.700735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.727060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.727702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.727974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.728235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.757137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:36.759560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:36.760520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:36.761386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:36.765140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 309/622] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:36.766754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.835217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a1c69-d9b3-40e1-9c00-ef21c7e0c033 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.837900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:36.878578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.879638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.880128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.880612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.885292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:36.888986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.890537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:36.903371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:36.904351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:36.905301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 314/623] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:36.913205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:36.933290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf90cb-7c86-48bb-8279-138c0c883de5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:36.966800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:36.967408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:36.967680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:36.967945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:36.968726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:36.969062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:36.970452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:36.978990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 310/624] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:36.979857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.014461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165211b2-3c55-4a6e-8633-18abb7cf857f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.048732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215759-be43-4439-8059-9c143c162335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.049371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215759-be43-4439-8059-9c143c162335 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.049647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215759-be43-4439-8059-9c143c162335 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.049912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8215759-be43-4439-8059-9c143c162335 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.050599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215759-be43-4439-8059-9c143c162335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:37.050888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215759-be43-4439-8059-9c143c162335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.052336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8215759-be43-4439-8059-9c143c162335 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.065099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 315/625] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:37.066036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215759-be43-4439-8059-9c143c162335 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.080571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1516df7-76ea-4957-9d37-c58f3109f8ef None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.091243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.115306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.115788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.116056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.116317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.118144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.129139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:37.134541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:37.135896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:37.137094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:37.144126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 311/626] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:37.145209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.173048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8215759-be43-4439-8059-9c143c162335 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.208203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.208203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.208950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.208950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.222062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.223519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:37.238730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:37.239931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:37.240838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:37.240838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:37.240838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:37.240838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 316/627] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:37.241203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.265475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61e1b-4535-4622-94fa-9b5f2d249ee9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.303355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.304345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.304718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.305124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/21dcdde810504ecf963f7b4abc93270c/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.321586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=21dcdde810504ecf963f7b4abc93270c, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.323372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.334538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.339454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 312/628] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:37 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/21dcdde810504ecf963f7b4abc93270c/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:37.340560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.359830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fea3-1077-47d4-9360-d766dd544c91 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.397354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.401273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.401902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.402188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.402436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.403260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:37.403556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.406417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.415765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 317/629] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:37.421414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.463293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e89633-c57b-4cfd-ba41-39ea42ff629b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.503079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.504218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.504690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.505205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.506076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:37.506663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.508353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.521572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 313/630] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:37.529141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33848ac3-798c-417d-993f-009b9f986073 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.531257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.575492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.576199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.576478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.576746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.585417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.589457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.591351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:37.608484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:37.609591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:37.610522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:37.610522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:37.610522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:37.611143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 318/631] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:37.616807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.693423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756f635-df84-4297-bbec-003af5d421bf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.697520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.757616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.758785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.759061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.759330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.769723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.771856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.774879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412ca52-2043-4e29-91bb-f2431f4f866c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-88d31026-cf33-44d6-9130-066a049991c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:37.787139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:37.788158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:37.789127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 314/632] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:37.790632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1608-da79-4f3c-9e31-6e6adb86cd10 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.791130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1608-da79-4f3c-9e31-6e6adb86cd10 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.791730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac1608-da79-4f3c-9e31-6e6adb86cd10 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.793549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 315/633] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:37.797696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1608-da79-4f3c-9e31-6e6adb86cd10 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.822888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.823904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.824355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.824798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.826101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:37.826574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.828714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549f7a-dcbd-42dd-afe3-e63110debd98 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.844837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 319/634] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:37.850314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.850593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.850863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.869407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:37.870520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:37.916948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac1608-da79-4f3c-9e31-6e6adb86cd10 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:37.919222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:37.949190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 320/635] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:37.950120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:37.953560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:37.954474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:37.954965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:37.955420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:37.956402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:37.956991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:37.958692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:37.977592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 316/636] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:37.987491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.037264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.134848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515f451-b472-4925-8af7-2f27cc31f208 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.156495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e05e02-092a-4f3b-b379-e211abc2ee09 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.202962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.203604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.203875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.204144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.213457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.220149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.227470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.228094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.228368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.228636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:38.245614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:38.246749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 321/637] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:38.247705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.292516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.311280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.312764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.337194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.356260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224381f-965f-44e8-8236-109d9f98975d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.391700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.392598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.392871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.393166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.404844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f2c3b078-66d0-4647-ba3a-a9f7d1b61933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:38.410411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:38.411445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:38.412432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 322/638] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:38.413803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e913-db22-4d1b-b6e7-3589015f9e1b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.413803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e913-db22-4d1b-b6e7-3589015f9e1b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.413803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e913-db22-4d1b-b6e7-3589015f9e1b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.414825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 323/639] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:38.419808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08e913-db22-4d1b-b6e7-3589015f9e1b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.431946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 317/640] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:38.431946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.527712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.532211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08e913-db22-4d1b-b6e7-3589015f9e1b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.535151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf1f4-f568-4dd5-9e5f-b6b18761fa1d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.558464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.569058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.569771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.570047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.570317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.571045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:38.571368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.571486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.571978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.572246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.572564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.572880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.573255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:38.573545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.574923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dab42-eadf-4ca5-8452-4eb7cd9cf212 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.583359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 318/641] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:38.584499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.584777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.585074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.600586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 324/642] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:38.600586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.603009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:38.604282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:38.676534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 319/643] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:38.677344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.726698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7258f-29a6-43e4-85bf-d8695594cb9a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.772185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.773559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.774036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.774497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.788454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.789771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc1b51-a312-48c7-879c-4b82f4e988d6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.790097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:38.805419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:38.806494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:38.807485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:38.807485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:38.807485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:38.809477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.811546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 325/644] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:38.812434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.825512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:38.838439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.839596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.840441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.841043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:38.855058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:38.857091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:38.872029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:38.873035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:38.874244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:38.874244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:38.874244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:38.874244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 320/645] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:38.874244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:38.923854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfee5d-43fd-4f12-8060-d7436eb48a06 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:38.959801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:38.960328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:38.960601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:38.960869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.000203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5cb2-e1c6-430f-b17b-e247e9ce75e8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.033761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.034349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.034464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.034629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.034898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.035534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.035827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.036831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.037203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.049084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 321/646] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.049904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.058250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.080343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.150019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 326/647] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:39.150019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.162576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e83c4a-0934-4bb8-92ca-d81ac75bda5b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.201945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.202564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.202870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.203114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.203721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.204017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.205421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.218701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 322/648] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.219864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.257983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8011d47-df7b-4f0e-884d-011037841aaf None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.271482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.296831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.297603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.297877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.298145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.309054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:39.312347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:39.313844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:39.320772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 327/649] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:39.321678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.333040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca829565-a679-48ab-81e3-52fa5618b501 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.372642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.373323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.373776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.374570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.382102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.383549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:39.394786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:39.395725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:39.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 323/650] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:39.397162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.428300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65b4e-bc62-4fa2-ba76-45061ab7c868 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.463340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.463973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.464244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.464505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.475772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.477296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:39.491662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:39.492849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:39.494411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:39.494411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:39.494411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:39.494411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 328/651] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:39.494411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.508558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212299e9-c904-4083-8426-3c128a962cfe None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.517071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.541951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.542585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.542858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.543124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.550446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.551892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:39.562912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:39.564041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 324/652] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:39.565249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.574165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.596933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be533-eb35-4be6-bce4-179dabd16500 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.631731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.632343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.632619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.632890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.633578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.633876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.635254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553fc65-2087-488c-aa8d-bb2c037c0e98 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.643122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 329/653] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.644327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46b6d-26a9-4ab6-af62-73c0014d56a4 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.644613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46b6d-26a9-4ab6-af62-73c0014d56a4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.644886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46b6d-26a9-4ab6-af62-73c0014d56a4 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.646101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 330/654] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:39.646808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46b6d-26a9-4ab6-af62-73c0014d56a4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.666771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0108fe-ed48-42e5-9dab-eaf6e5ff2169 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.698962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.699582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.699858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.700124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.700813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.701150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.702590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.714648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 325/655] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.715315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.734508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.750973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46b6d-26a9-4ab6-af62-73c0014d56a4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.778906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.786216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.786825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.787100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.787360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.788105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.788402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.789812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.801834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 331/656] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.802842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.814531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731205-607f-463f-bd69-7bd61f5e8056 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.848648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.849270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.849543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.849805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.850528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:39.850824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.852248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601ae8-5bfe-4463-9384-1faf43f5d9e3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.869814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 326/657] 10.222.0.93 () {56 vars in 1139 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:39.870782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.871057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.871323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.888628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:39.889828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:39.904117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424f79-30c8-4e32-90fd-7b8f39bbdf4f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:39.937698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:39.938325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:39.938593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:39.938856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:39.949010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:39.950449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:39.952921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:39.955724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 327/658] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:39.956587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:39.965923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:39.967024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:39.967945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:39.967945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:39.967945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:39.967945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 332/659] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:39.969829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.027312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.074938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f5e12-e6b4-4e77-86a1-3a7e2f93e481 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.077277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfa5d4-c1f2-400c-b70c-54c7c0647205 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.109470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.110074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.110363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.110600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.110978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.111316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=284f6ac815d940ccb5f3dc7755bc201e) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:40.111611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.111712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.111886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.112154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.113059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.129344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.129555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 328/660] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/role_assignments?user.id=284f6ac815d940ccb5f3dc7755bc201e&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:40.129555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.129751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:40.143011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:40.144001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:40.144936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:40.151660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 333/661] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:40.153111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.256852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6b8b4-204b-4850-8925-7f4b348e7ac0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.265275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.282526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.304674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.305357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.305635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.305904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.318624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ac7e3-dfc8-49b1-ab9d-d3ef2aecc9b0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.357303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.358234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.358507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.358776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.359410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:40.359709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.361118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.373371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 334/662] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:40.374371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.388685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.390305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.480143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5c77-19b7-41be-9166-694752d5c5bd None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.492727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 329/663] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:40.493618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.503180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.513390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.522916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.523871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.524141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.524407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.525138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:40.525421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.526906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.543370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 335/664] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:40.543370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.620086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da67a7c-bc93-4580-afe4-1045893a58df None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.660605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f7594-cec4-4ee8-a203-92d2a06e3fdc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.661389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.662099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.662463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.662733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.677274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:40.684549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:40.685535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:40.686402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 330/665] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:40.687110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.710885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.711904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.712361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.712808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.721052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.722865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:40.734796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:40.736043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:32:40.737243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:40.743266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 336/666] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:40.743266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.784143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.784353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:40.813639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821332c8-cab8-4cd7-82bb-25865e52e5be None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.857322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.858119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.858490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.858906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.863702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58b31-4a9b-42f6-9a86-8c4e66bc4f34 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:40.869802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.871363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:40.885876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:40.887072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:40.888178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:40.888178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:40.888178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:40.888802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 331/667] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:40.889346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:40.916526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:40.917477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:40.917858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:40.918520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:40.919613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:40.920151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:40.922318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:40.940065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 337/668] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:40.940065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.042547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014b47-f362-4813-b5c2-196ac8efca76 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.074553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.078339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b731-b2cc-40e5-bb19-164d325ba1f6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.105470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.113802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.114826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.115250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.115662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.116484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:41.116983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.118746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.129959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 332/669] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:41.130897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.131441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.131580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.131834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.132105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.132910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:41.133227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.134749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.163605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 338/670] 10.222.0.93 () {56 vars in 1137 bytes} [Wed Aug 24 15:32:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:41.164786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.267151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be576846-bf69-4b9b-8b27-d429ec25632e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.311285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61098d-c3c5-41e6-9b8e-3dea34f6a2f6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.314718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.315344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.315677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.315943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.316657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:41.316991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.318382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.331650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 333/671] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:41.332420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.357074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.358174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.358582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.358978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.373474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.375247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.391121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:41.396288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:41.397534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:41.398987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:41.398987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:41.398987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:41.405771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 339/672] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:41.405771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.420089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.464083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013402a-b9ab-4f49-92ae-7bdef35e0b02 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.507997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.509080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.509589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.510118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.514534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf609-eac7-4ae0-a1c2-0b398eb91a90 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.549975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.550620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.550897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.551165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.558736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.560247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:41.574347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:41.575309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:41.576198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 340/673] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:41.576709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.587682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.590049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.644695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.658120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.693378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1bfd8-e2c1-4e2a-831e-ec724a09649d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.699044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 334/674] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:41.700122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.730788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.731512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.731792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.732056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.732723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:41.733229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.734602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.752449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 341/675] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:41.752449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.811057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee434c7-a829-4fa2-9a1a-a80204bf910f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.847157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.848128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.848603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.849106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.850085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:41.850683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.852305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.859498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d8b9-4a64-487e-ade8-71c1bbf2762c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:41.865338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 335/676] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:41.866364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.881877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.891644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:41.898827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:41.899813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:41.900459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:41.900856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:41.912346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:41.914334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:41.930377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:41.931566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:41.932553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:41.932553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:41.932553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:41.933288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 342/677] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:41.934248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:41.982116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239cc36-4f1a-44d0-80fe-c6fb1f113db9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.019252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.020241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.020696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.021166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] PATH_INFO: `/v3/users/swift` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.029981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.031916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:42.044436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:42.045544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:42.046605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:42.053841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a8f9-0468-480a-aa72-8cf93fa1bea9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.054203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 336/678] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:42.055297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.088181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.088799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.089121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.089633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.090510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a6987a8308864fb599f4a2a2ecfa226a) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:42.090889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.092586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.099355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 343/679] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:41 2022] GET /identity/v3/role_assignments?user.id=a6987a8308864fb599f4a2a2ecfa226a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:42.100219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.142446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:42.168644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0bb97-dac5-402b-823d-05ff58ecc3de None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.178506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:42.213960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.214982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.215554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.216027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.216953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:42.221244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.223984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad457d4f-1c7c-40ff-9864-20404ceafb0a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.240394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 337/680] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:42.242255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdb2-d62a-46af-a572-915cd7708975 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.242752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdb2-d62a-46af-a572-915cd7708975 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.243221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdb2-d62a-46af-a572-915cd7708975 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.245085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 338/681] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:42.248661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bdb2-d62a-46af-a572-915cd7708975 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.270411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5b104-1125-48bc-8b3c-feb25456ca30 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.330528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.331200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.331200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.331367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.332529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:42.332529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.334453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541f3c1-41ec-4504-a557-857a84981506 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.355453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 344/682] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:42.357136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.357636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.357968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.377768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:42.378400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:42.391750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bdb2-d62a-46af-a572-915cd7708975 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.431961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:42.437616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.438421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.438722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.439068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.446697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.448347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.461013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 345/683] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:42.462280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:42.466644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:42.467522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:42.468432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:42.475032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 339/684] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:42.475970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.537189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:42.590121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def86bbd-8967-4d51-8e11-ddbcca64bda3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.629458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.630468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.630909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.631322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.632585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:42.633319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.635271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.649409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 340/685] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:42.658636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.683678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557614-4450-44fd-8682-9a5528ce2bb7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.716933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:42.735624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.736241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.736504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.736777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.796642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555f6a-b861-4594-bd15-0afb5c876417 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:42.832867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:42.833446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:42.833719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:42.833988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:42.834709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=8620b3bc47e241b18a60bd7f43fd4f57) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:42.835009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.836460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.844942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 341/686] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/role_assignments?user.id=8620b3bc47e241b18a60bd7f43fd4f57&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:42.881368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:42.883100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:42.897866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:42.967327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.062971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 346/687] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 15:32:43.069829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.070101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628a3fe-a06f-4687-9302-a19dea85bf31 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.097540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.120369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.121043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.121320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.121587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.133817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.135401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-0165aaed-fd88-43ab-8bf6-b5f5ddee0da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:43.150945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:43.151971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:43.152876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:43.152876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:43.152876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:43.152876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 342/688] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:43.153924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d387-e6e6-498b-97a1-a8d6b2aacd06 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.154209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d387-e6e6-498b-97a1-a8d6b2aacd06 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.154482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d387-e6e6-498b-97a1-a8d6b2aacd06 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.155950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 343/689] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:43.161085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d387-e6e6-498b-97a1-a8d6b2aacd06 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.200479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557820b-f134-4f62-a6cc-8a9ffdf86601 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.244665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.245708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.246202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.246678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.249286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.259936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.261829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-ea247d93-e2a6-40f8-8e67-6fc565725694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:43.278658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:43.279651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:43.280566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:43.280566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:43.280566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:43.287077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 347/690] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:43.287835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d387-e6e6-498b-97a1-a8d6b2aacd06 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.288807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.289247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.289788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.309688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:43.311189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:43.329713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.330718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.331445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.331827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.332659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:43.333106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.334654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.355459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 344/691] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:43.355459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.386856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.391217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 348/692] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:43.392727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.465049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d07ba1-3b2d-4c11-965a-1ff36f418451 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.500916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc8c9-52f5-41c7-8397-1cc852869381 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.504504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.504670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.504962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.505185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.505839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:43.506132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.507519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.524924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.525116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 345/693] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:43.538618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.544365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.545373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.545870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.546345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.547186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.548825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.577728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 349/694] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:32:43 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:43.659517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:43.674584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bb5c-d58b-48e9-8447-11c4bbdb8b95 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.716516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.717593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.718069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.718551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.726145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.727873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:43.740935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:43.741924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:43.742852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:43.745351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 346/695] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:43.751715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.858615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c34d4-9fee-4cfc-a2f2-595b00ea395d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:43.894725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:43.895788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:43.896311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:43.896787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:43.897783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:43.898642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:43.900295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:43.912539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.914801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 350/696] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:43.920941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:43.952808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:44.026069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541cb14-22ec-49c7-8978-422344017429 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.032200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40407-8534-458c-b872-b9af9c110c78 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.064241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.065051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.065426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.066057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.067710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=21dcdde810504ecf963f7b4abc93270c) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:44.067710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.070402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.071563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.072396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.072942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.073356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.078018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 351/697] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/role_assignments?user.id=21dcdde810504ecf963f7b4abc93270c&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:44.086617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:44.092513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:44.093607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:44.094454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:44.097497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 347/698] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:44.106105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.223438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:44.234268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77dca6-c78f-4347-aedd-580473b89623 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.275520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.276147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.276426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.276693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.277391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:44.277693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.279071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879538e-71b3-4f1b-8802-e77c8f605cf0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.288132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 352/699] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:44.293898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.313294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:44.372677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06bee-5019-489f-b048-17acdb825cae None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.373019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06bee-5019-489f-b048-17acdb825cae None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.373257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f06bee-5019-489f-b048-17acdb825cae None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.374930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 353/700] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:44.380323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.380608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.380882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.407785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb465-0b79-4c39-b15e-64c7c89446fe None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.408244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:44.409477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:44.443771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.444411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.444690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.444989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.455965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.458306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:44.475068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:44.476030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:44.477406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:44.477406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:44.477406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:44.477406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 348/701] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:44.482665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.489843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 354/702] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:44.553173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:44.597401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd631d6d-29b4-4a2a-8ba6-997e1aa4ac9b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.631676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.632355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.632635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.632910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.633570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:44.633864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.635345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.647869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 349/703] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:44.653617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.743617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:44.756019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bcd2-f236-4cec-80fc-337f7c0be727 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.791817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.793167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.793864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.794139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.794404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.802066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.804451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:44.823639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:44.824662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:44.826265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 355/704] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:44.830515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:44.936322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3455-5329-43fc-bf97-58989ebc09ac None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.969320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072a88f-910e-4505-8bb5-e3604dfcd456 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:44.971859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:44.972481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:44.972756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:44.973062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:44.973795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:44.974098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:44.975651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:44.995099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 356/705] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:45.000634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.005352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.010769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.042096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.042748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.043022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.043288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] PATH_INFO: `/v3/services/network` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.049971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.051373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:45.072236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:45.073403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:45.074275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:45.078405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 350/706] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:45.084521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.140619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69bf6-80d4-4cc0-adc1-567965dfba1f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:45.185553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.186186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.186711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.186986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.193375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e04f0-bf1e-4a23-96ac-eed8e5d2af35 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:45.242287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.242978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.243256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.243571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.244465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] RBAC: Adding query filter params (name=network) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:45.244771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.246578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3fca1-f809-4a00-9447-adfdfcadd0ec None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.252184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 351/707] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:45.253456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2a9c-34dc-410d-a55c-b7df9c1761a7 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.253737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2a9c-34dc-410d-a55c-b7df9c1761a7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.254055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d2a9c-34dc-410d-a55c-b7df9c1761a7 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.259707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 352/708] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:45.260549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2a9c-34dc-410d-a55c-b7df9c1761a7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.272786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.274656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4b43e-2784-477e-a105-c6dfcd8895e6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.283191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.329357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.389874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 357/709] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:45.391459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.391891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.392330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.393821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d2a9c-34dc-410d-a55c-b7df9c1761a7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:45.414424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:45.416276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:45.432400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.433080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.433423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.433841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.434412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] RBAC: Adding query filter params (type=network) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:45.434813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.436248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.443004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 353/710] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:45.443928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.539919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 358/711] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:45.570353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa227-3e94-4c0d-bfee-59f7bc9a43eb None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:45.584644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.616206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.616882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.617181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.617450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.634758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.636298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:45.652510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:45.653612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:45.654558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:45.654558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:45.654558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:45.658152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 354/712] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:45.663829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.714142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:45.784099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efc8ec-0a1b-4b1e-b3bc-ee1708f596d5 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:45.820760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:45.821806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:45.822396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:45.822852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:45.823670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:45.824146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:45.825739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:45.841018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 359/713] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:45.846879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.952328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:45.995450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274df8d7-8c3c-4b8d-82f7-3b983f9a71b1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.060881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.062032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.063337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.064356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.076516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.078553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:46.101872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:46.102874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:46.103871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:46.114180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 355/714] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:46.118232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:46.140272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:46.150615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c239-b0d3-4279-9dcf-a9e187272233 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.177269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:46.231836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.232489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.232764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.233068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.233663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.235051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:46.261689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:46.262738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:46.263575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:46.270733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 360/715] 10.222.0.93 () {56 vars in 1129 bytes} [Wed Aug 24 15:32:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:46.274661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:46.311954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e44aa-3b9a-492d-aaf6-746dfe161699 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.373333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.374405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.374906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.375382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.376278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:46.376769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.378449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314a1e-f986-4b3f-9e5b-0686d4715d9d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.393497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 356/716] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:46.394848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1c24-52f2-4bbe-ac25-05f0b0f02751 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.395141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1c24-52f2-4bbe-ac25-05f0b0f02751 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.395411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a1c24-52f2-4bbe-ac25-05f0b0f02751 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.401176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 357/717] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:46.402019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1c24-52f2-4bbe-ac25-05f0b0f02751 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:46.430328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605140d-a6eb-4d97-bb09-8b04b6da9051 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.467440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.468411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.468932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.469410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.470319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:46.470914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.472483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49f15-7650-4942-b7a1-54ddea645dd1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.477787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 361/718] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:46.479392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ab33d-40d5-4ff0-b78a-595867f9cf83 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.479884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ab33d-40d5-4ff0-b78a-595867f9cf83 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.480346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ab33d-40d5-4ff0-b78a-595867f9cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.489101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:46.501916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-919ab33d-40d5-4ff0-b78a-595867f9cf83 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:46.503446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-919ab33d-40d5-4ff0-b78a-595867f9cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:46.506119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a1c24-52f2-4bbe-ac25-05f0b0f02751 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.528018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:46.549621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.550237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.550509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.550774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.551596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:46.551900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.553471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.559623 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 358/719] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:46 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:46.560712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:46.579694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 362/720] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:46.626276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aa93-dcf4-4130-835a-babcc1cd7ec1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.626589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aa93-dcf4-4130-835a-babcc1cd7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.626800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91aa93-dcf4-4130-835a-babcc1cd7ec1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.628405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 363/721] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:46.634015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.634299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.634575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.657536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:46.658758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:46.730728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7c925-1797-444a-832f-561ea87644c0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:46.791026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:46.791511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:46.791785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:46.792051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:46.792699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:46.793022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:46.794522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:46.801264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 359/722] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:46.803133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 364/723] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 15:32:46.891820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:46.909168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.000320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769fe2f-2c13-4fac-a47f-e5e2ff0c995e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.034801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.035440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.035715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.035983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.047115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:47.052278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:47.053222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:47.054109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 360/724] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:47.059858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.090475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.153068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.173350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b279d-60c1-437b-a6e2-1947dda656b9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.190822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.223172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.224183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.224748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.225211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.226058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:47.226759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.228280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.238429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 365/725] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:47.246309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.270576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c7dc-2a11-4219-9e68-f99e4eda72bf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.309108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.309859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.310239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.310519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.321611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:47.327206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:47.328171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:47.329051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 361/726] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:47.336028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.439885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9602c1-2f0a-4516-bb67-c61285825b76 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.517489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.518626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.519135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.519933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.525436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecfe1b-08de-41a0-8ed0-824b286fb204 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.553612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.560252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.573299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:47.602763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:47.604871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:47.606887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:47.606887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:47.606887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:47.609957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 366/727] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:47.616921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.628945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.633561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.634505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.635002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.641273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.642171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:47.642628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.644196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.656329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 362/728] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:47.662013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.725584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40946f2b-9b40-4118-a7a5-eb9aa4f60b45 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.762470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.763087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.763362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.763629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.764271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:47.764567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.765984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889081be-3b28-47de-90d7-ac8755b6864c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.778958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 367/729] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:47.780224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ab34-4156-4447-8162-e35d40248eff None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.780504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ab34-4156-4447-8162-e35d40248eff None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.780773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ab34-4156-4447-8162-e35d40248eff None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.781986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 368/730] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:47.783968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14ab34-4156-4447-8162-e35d40248eff None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.795757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c838-d221-4e02-860c-355a434a7cd8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.838727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.839811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.840086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.840357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.854445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.856657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.858379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ff74a0a1-82e0-4859-8452-8ecd3d830d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:47.878140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:47.879378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:47.880486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:47.880486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:47.880486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:47.882417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 363/731] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:47.884517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.885056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.885470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.909344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:47.909953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14ab34-4156-4447-8162-e35d40248eff None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:47.910551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:47.952253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:47.953307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:47.953788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:47.954336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:47.958035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:47.964729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:47.966643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:47.980028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:47.981029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:47.982064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:47.984874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 369/732] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:47.985757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 364/733] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:47.986191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:47.998041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.096254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd82555-1133-49eb-8b6b-61bda3d9dd40 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.115476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.138120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1fb3-0f8b-4d2f-9fe1-54b97e3c137c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.154576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.155556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.156084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.156567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.157473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:48.157979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.160005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.176229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 370/734] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:48.182801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.234013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.234657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.234932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.235200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.235955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:48.236257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.237792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.281087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 365/735] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:32:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:48.286187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.327543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.328636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bafb60-88b2-46bd-869a-d1d4582d9f2a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.387803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.389073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.390081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.390857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.401421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.403745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.409192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5303ad-1868-4d1c-b65b-84bfe87460ee None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:48.419226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:48.420458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:48.421830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:48.424781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 371/736] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:48.426143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.450776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.451854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.452228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.452600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.480839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.531142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.532928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.556446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05113-f098-4676-85a5-50b4821e2a86 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.567595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.598505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.599227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.599568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.599905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.600621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.602199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.621649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 372/737] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:32:48 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:48.630213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.646766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 366/738] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:48.648949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.819296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.827180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07834a5-5205-45cd-a376-fd359e36fda2 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.843823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124a395-9f8e-428a-acc1-e8078c2aa442 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:48.872156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.872973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.873358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.873719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.876667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:48.886570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.888473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.896523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:48.897363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:48.897638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:48.897915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:48.899122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:48.899427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:48.900935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:48.905252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:48.906264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:48.907150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:48.907150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:48.907150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:48.911153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 367/739] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:48.912364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:48.920699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 373/740] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:48.925890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.030984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8186d-1623-408e-a27b-bfae82463a26 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.050582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa8f43-d2ea-49a6-b2a2-df1f5d8e667b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.067479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.068096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.068368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.068863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.070026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:49.070268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.071664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d837-767c-4b9f-bb7f-f547c84c0c6f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.087810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 368/741] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:49.089682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc9ba-7568-4e9a-a254-c410b99cdf88 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.089971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc9ba-7568-4e9a-a254-c410b99cdf88 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.090237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc9ba-7568-4e9a-a254-c410b99cdf88 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.093005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 369/742] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:49.093852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bc9ba-7568-4e9a-a254-c410b99cdf88 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.097920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.098553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.098872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.099145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.123195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.158394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.178401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.179874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6e29-63d5-4a05-8d73-3e79793bf253 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.228320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bc9ba-7568-4e9a-a254-c410b99cdf88 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.263220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.263878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.264127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.264389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.271250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.272703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2abb4b79-3b68-426a-affa-96dc46911c4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:49.285305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:49.286241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:49.287232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:49.295162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 374/743] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:48 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 15:32:49.295335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 370/744] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:49.295417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.295417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.295417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.295602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd669a-58da-4020-8d3a-b5d31f83068a None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.295602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd669a-58da-4020-8d3a-b5d31f83068a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.295602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd669a-58da-4020-8d3a-b5d31f83068a None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.295602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 371/745] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:49.295843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd669a-58da-4020-8d3a-b5d31f83068a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.316952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:49.318133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:49.370797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.396956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 375/746] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:49.396956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.407101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd669a-58da-4020-8d3a-b5d31f83068a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.415248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.445753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.445997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.446096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.446394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.447082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:49.447522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.449030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02244-858a-438e-8c37-4d305d942be9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.466225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 372/747] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:49.467537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.467814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.468193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.487129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:49.487973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:49.526767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e2fe1-2a64-4dec-b5f8-42ad1aff6fa2 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.562902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.563730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.563912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.564223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.573327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 373/748] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 15:32:49.574411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.583029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.584483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:49.609206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:49.610208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:49.611100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:49.611100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:49.611100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:49.614804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 376/749] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:49.617776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.670900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.697903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87acc4-fdc5-4ddb-8125-664cee2e953c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.717281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.739606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125229-185a-4918-a279-d6cc5af76174 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.741038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.741981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.743161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.743610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.744546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a75d087fed3c4c289db13b0344b3b422) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:49.745086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.746702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.755306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 374/750] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/role_assignments?user.id=a75d087fed3c4c289db13b0344b3b422&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:49.756309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.813089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.813813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.814238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.814410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.815175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:49.815596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:49.817409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:49.843408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 377/751] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:49.849538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.877474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962086-cd5e-4ea0-8f65-efd796e9ceb8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:49.925239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:49.927495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:49.927999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:49.928447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:49.944527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:49.952878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:49.953970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:49.954829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:49.958273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 375/752] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:49.959333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:49.985112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.991163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:49.994826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07b198-9c18-44cf-b0e5-1415c235ac51 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.037002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.037912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.038190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.038458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.047638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.049166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:50.064064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:50.065036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:50.065942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:50.068980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 378/753] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:50.069820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.082897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f304e-1b3a-4320-9d44-81dcbeaed798 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.125251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.126141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.126419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.126690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.127521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.129351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.153454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 376/754] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:32:49 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:50.154374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.243082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944322-103f-4230-be77-1f8ebfff06ed None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.270310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:50.300610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4603ebb-cdd0-4f9d-9b19-3992b924e53f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.340568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.341236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.341612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.341948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.342669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:50.343080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.344921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.358452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 377/755] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:50.364558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.364799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.365224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.365499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.365768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.366450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:50.366755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.368232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.392286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 379/756] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:50.397798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.421909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:50.489744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c02f8-803a-4600-9e9f-00400944a957 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.521430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579beee-de56-48ff-931a-528c2a4a5de7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.537985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.539073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.539348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.539754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.540603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=21dcdde810504ecf963f7b4abc93270c) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:50.540996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.543104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.551554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 378/757] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/role_assignments?user.id=21dcdde810504ecf963f7b4abc93270c&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:50.552052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:50.561830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.563245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.563714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.564175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.577662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.579730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-54af9b46-f3f6-4ad1-9c11-850e98f3a321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:50.597484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:50.598542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:50.599457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:50.599457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:50.599457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:50.601774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 380/758] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:50.607941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.752950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1f991-3c20-4330-a90e-32f38d505b50 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:50.779025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8849c02-f6ac-49b8-a191-d1823318ac2a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.785637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8849c02-f6ac-49b8-a191-d1823318ac2a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.786118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8849c02-f6ac-49b8-a191-d1823318ac2a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.787732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 381/759] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:50.793482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.794006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.794112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:50.794606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.794726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:50.794966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:50.795241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:50.795890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:50.796187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:50.797612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:50.816833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 379/760] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:50.822542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:50.826420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:50.832061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:50.925293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:50.941975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:50.956003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 382/761] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:32:50.987126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a56125-2e5f-4463-82ca-a52cf99ad21c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.026413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.026968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.027241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.027510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.034909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.036379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:51.049132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:51.050133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:51.051101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 380/762] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:51.057774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.222527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94b41-e8f1-49fa-b725-3edc8e79c26f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.267964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.268574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.268852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.269146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.269873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:51.270174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.271599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.288299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.296940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 383/763] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:51.307435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.409957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf439-d407-4997-8cad-b248cfaa2a1c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.422227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:51.441299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:51.451797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.452443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.452722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.453029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] PATH_INFO: `/v3/services/network` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.453618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.455025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:51.465088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:51.466076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:51.466916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 381/764] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:51.473187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.504591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fac4f2-407e-45f3-a62d-3da1be0095e9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.572917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.573536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.576924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.576924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.597351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.598954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:51.625575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:51.626636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:51.627535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:51.627535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:51.627535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:51.633393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 384/765] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:51.638046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.660861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa8978-4d4f-4dfb-92dd-1e99372c7a72 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.729061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.729677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.729950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.730217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.730855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] RBAC: Adding query filter params (name=network) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:51.731152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.732540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.744510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 382/766] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:51.749711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.831256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa35e0b-9cbe-4b57-a4b0-a9b150803a8b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.845019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:51.853223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:51.900534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3cbbe-df46-46f1-93e9-71afcfc5bd24 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:51.926956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.928674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.930626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.931116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.932261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:51.933780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.935454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.952599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:51.953865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:51.954338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:51.954801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:51.955650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] RBAC: Adding query filter params (type=network) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:51.956156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:51.958563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:51.961733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 385/767] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:51.967181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:51.968096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 383/768] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:51.975249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.110556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931eb71-fe50-4145-ae53-98c04bbb3505 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.123719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9041-ead8-403c-a8e9-f5fc7b8f036d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.124653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:52.149078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.150091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.150614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.151081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.151990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] RBAC: Adding query filter params (interface=public, service_id=f7bcf04ecf5e473bafe0e600e2323b80, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:52.152554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:52.154198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638a66-f61b-43d4-80ca-f787b673574a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:52.161718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.162360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.162650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.162918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.164231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 384/769] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/endpoints?service_id=f7bcf04ecf5e473bafe0e600e2323b80&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:52.165746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46457b7-1fc7-40fc-802f-4b6a010196b9 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.166261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46457b7-1fc7-40fc-802f-4b6a010196b9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.166736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46457b7-1fc7-40fc-802f-4b6a010196b9 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.168177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 385/770] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:52.174499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.177308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.177971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.179900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:52.181779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:52.195403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:52.196353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:52.197389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:52.198652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:52.199931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:52.200122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 386/771] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:52.201112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.244346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:52.309274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 386/772] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:32:52.310369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.327678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbedd79-f8e8-48fb-937f-186b39686bfe None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.362834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.363753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.364236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.364699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.365533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:52.367108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:52.373210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 387/773] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:32:52 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:52.477671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c724a7-b3ef-47da-81d0-1ad6d380697b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.489473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:52.533678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.534313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.534583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.534845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.535557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:52.535849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:52.537356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33879-d190-4d90-862b-dbf95f318728 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:52.555163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 387/774] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:52.560787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.635945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e45-8b2b-4260-b25e-90bd23485815 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.636555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e45-8b2b-4260-b25e-90bd23485815 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.637185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e45-8b2b-4260-b25e-90bd23485815 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.639276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 388/775] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:52.645787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d0ec-f79d-4e33-a205-41f33b79635b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.646345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d0ec-f79d-4e33-a205-41f33b79635b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.646820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33d0ec-f79d-4e33-a205-41f33b79635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.665144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:52.675571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3e33d0ec-f79d-4e33-a205-41f33b79635b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:52.676839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3e33d0ec-f79d-4e33-a205-41f33b79635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:52.678574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3dd54-a371-49ba-ab73-f0b5ed033bd8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.716298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.716671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.716921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.717207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.719079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=79b6528e8e264539aae69a23f7e2b4e0, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:52.720517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7857b-c0af-416d-8a65-58ad1a471b86 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:52.736955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 388/776] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:52 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:52.738247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204228cd-6ccf-4d8a-b409-fd4ca4a6fe09 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.738533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204228cd-6ccf-4d8a-b409-fd4ca4a6fe09 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.738799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204228cd-6ccf-4d8a-b409-fd4ca4a6fe09 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.740063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 389/777] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:52.745162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204228cd-6ccf-4d8a-b409-fd4ca4a6fe09 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.760384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 389/778] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:32:52.762499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.763026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.763565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.785541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:52.787169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:52.859460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204228cd-6ccf-4d8a-b409-fd4ca4a6fe09 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:52.865050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 390/779] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:32:52.918358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:52.918358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:52.918358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:52.918358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:52.933921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:52.938527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:52.939577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:52.940443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 390/780] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:52.947988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:52.982309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.051348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.068283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35bfd8-f5db-4023-9947-5ed45219c317 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.071707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.107805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.108429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.108694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.108989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.109828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:53.110051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.111663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.120686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 391/781] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:53.126067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.179271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb7b1-1abf-46ba-b0b7-fe8562e9af40 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.218848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.219972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.220445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.220925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.221720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.225225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:53.237967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:53.239015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:53.239863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:53.242543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 391/782] 10.222.0.93 () {56 vars in 1129 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:53.243129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.278594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.292473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f49e2-6e1a-4609-b181-735fc6b10203 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.328068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.328709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.329032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.329305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.342903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.345266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.346138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:53.367299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:53.368349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:53.369327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:53.369327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:53.369327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:53.372528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9050-fab8-452d-86ba-68c7c1af295e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.375850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 392/783] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:53.376745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.415901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.416946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.417568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.418057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.431206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:53.437997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:53.438941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:53.439803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:53.445017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 392/784] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:53.445017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.502690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec2ec-e19f-4991-850b-e2ddcc8be793 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.546060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.547388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.547844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.548519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.549367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:53.550011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.551881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.558583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 393/785] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:53.559869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.564614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.572952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9d730-7078-44b5-a574-e1940acf3db8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.614944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.615662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.616047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.616406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.617488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:53.617888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.619513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.622471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.640056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 393/786] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:53.640056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.693469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28a84-d797-4be8-b09f-860893b857bc None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.739097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.740485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.741144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.741712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.742599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:53.743108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.743214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd72a0-502d-411e-81e5-c302a66a02f0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.746118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.756736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 394/787] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:53.758503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.787373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.788942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.789660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.790146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.791334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:53.792292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.794436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.803375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 394/788] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:53.804404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.837196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.876737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5427241-fa00-4b8d-90c8-272de1eed3cd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.886460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:53.918779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.919880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.920373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.920829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.929548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.931268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.931483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c4ce-bac3-475a-8259-b11e24f88370 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:53.943624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:53.944561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:53.945543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:53.948191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 395/789] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:53.949344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:53.965953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:53.966592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:53.966866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:53.967133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:53.978045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:53.979647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:53.993962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:53.994970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:53.995877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:53.995877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:53.995877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:53.995877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 395/790] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:53.995877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.063897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7fd3a-f628-40ec-85d2-6d9d9c50b8a8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.093472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.098828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bffd43-25ed-4d5a-b44c-4d1b81f3b45c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.104337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.105231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.105726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.106186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.107146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] RBAC: Adding query filter params (interface=public, service_id=15245dc9ed7644689690d175bb976dff, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:54.107656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.109803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.113429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.117436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 396/791] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/endpoints?service_id=15245dc9ed7644689690d175bb976dff&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:54.118434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.143218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.144179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.144621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.145290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.146624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:54.147073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.149519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.172632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 396/792] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:32:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:54.173755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.255389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e147628-e3c3-4fe6-8690-a90f1b458a5e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.292955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.294016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.294387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.294775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.295672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:54.296075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.298260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.314396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 397/793] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:54.315661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.319076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189afc-285b-474e-84b7-017669dfe198 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.368583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.369941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.370515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.371033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.371778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.374063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.377689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.382744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 397/794] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:54.383828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.429730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.484071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb0696-cd6f-4a6c-8013-7c82137eaac4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.541929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafab278-8857-4dbf-85f8-2f6835409e75 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.567495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.568152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.568431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.568704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.595009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.596501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.618240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.618929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.620195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.620825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ec1a9657-45be-4ffc-a72c-c9c8c3f7a174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:54.627013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:54.627985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:54.628889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:54.628889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:54.628889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:54.630432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 398/795] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:54.631764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8edd8-3a19-4c09-8ee4-39f8de444e35 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.632197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8edd8-3a19-4c09-8ee4-39f8de444e35 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.632385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.632759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8edd8-3a19-4c09-8ee4-39f8de444e35 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.633941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.634709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 399/796] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:54.637159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8edd8-3a19-4c09-8ee4-39f8de444e35 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-17afbe9a-01b0-425f-801c-24f3e7208822 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:54.651831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:54.652861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:54.653859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:54.657024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 398/797] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:54.658471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.658748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.659016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.679048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:54.680272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:54.764585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 399/798] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:32:54.765635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.806543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.881073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8edd8-3a19-4c09-8ee4-39f8de444e35 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.883707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:54.926824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356d6ce-e883-4878-9fa7-216b8208f235 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:54.927493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.928328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.928769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.929471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.930292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:54.931740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.933370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac8fa-1f21-402b-89bd-3b7bcf00e022 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:54.947772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 400/799] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:54.949773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b42b-c4b6-49d9-8705-390c12815043 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.950510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b42b-c4b6-49d9-8705-390c12815043 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.950996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b42b-c4b6-49d9-8705-390c12815043 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.953607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 401/800] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:54.954683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b42b-c4b6-49d9-8705-390c12815043 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:54.981231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:54.982192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:54.983176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:54.983649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:54.984879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:54.985622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:54.988007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4414d-c53a-48f6-9e52-3995eb8c65e4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.011892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 400/801] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:55.013674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.013674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.013876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.032361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:55.033646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:55.081836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b42b-c4b6-49d9-8705-390c12815043 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.115281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 401/802] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:32:55.116139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.124761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.125735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.126182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.126641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.134883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.135323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.137807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:55.150794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:55.151734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:55.152641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:55.154808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 402/803] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:55.155725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.186863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.252031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329ed8a-ee66-49e3-84b9-06d61fd9ee19 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.268382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd7ea0-0d46-4590-801c-ae5949525420 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.298029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.299614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.300142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.300673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.303338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.303960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.304258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.304494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] PATH_INFO: `/v3/services/network` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.305096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.306528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.313602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.315275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:55.315671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:55.316633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 15:32:55.317519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:55.321252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 403/804] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:55.323128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:55.340625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:55.341631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:55.342535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:55.342535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:55.342535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:55.342535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 402/805] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:55.343196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.415424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.427984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.444294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c4508-e873-4b70-a0e9-7c08f9fb2975 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.448489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63d8bb-3da5-4b6c-98ae-8c2bc13d6b5f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.481549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.482162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.482434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.482703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.483392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:55.483690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.483969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.484579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.484851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.485139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.485249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.485764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] RBAC: Adding query filter params (name=network) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:55.486084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.487383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.492275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 403/806] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:55.493152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.501519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 404/807] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:55.506928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.600265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcbdd9-fa7c-438d-9269-fdbeaf40029d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.617737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9981a9-10f6-444e-814e-a67c872edce8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.627408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.637016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.637631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.637907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.638175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.638824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:55.639149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.640573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.653138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 404/808] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:55.658698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.658698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.658698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.658942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.669718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:55.674905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:55.675839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 405/809] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:55.676707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.689684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.767633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e6ab-94b4-40cd-b9be-de9deb39cb50 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.785479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b616a7-add9-4789-a796-31598614c064 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.802870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.803478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.803754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.804022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.804643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] RBAC: Adding query filter params (type=network) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:55.804974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.806395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.811452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 405/810] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:55.812222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.823754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:55.824420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:55.824693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:55.824987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a75d087fed3c4c289db13b0344b3b422/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:55.839749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=a75d087fed3c4c289db13b0344b3b422, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:55.841245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:55.855212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 406/811] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:55 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a75d087fed3c4c289db13b0344b3b422/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:55.855688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:55.883872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.929744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:55.964881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4f9b-7d1e-4556-93d8-36a7e7679e5d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:55.991832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b2b75-99db-4cd0-9f1a-fba7d1e7b914 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.012613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.013288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.013562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.013827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.022419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.024226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:56.037263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:56.038205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 406/812] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:56.039800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.044959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.045129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.045352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.045609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.047006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:56.047006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.047960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.058569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 407/813] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:56.058569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.171701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eee9b-58e1-4774-ac00-a4f0a5b88e4e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.185740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef05fb-1bc3-41b5-b06d-fa05dfa2324b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.187203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:56.207844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:56.216297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.217454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.217931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.218417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.219277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.221020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.228050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.228698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.228991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.229259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.229952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:56.230245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.231806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.248279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 408/814] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:56.249475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.260082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 407/815] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:32:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:56.261520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.382876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b636886-68c4-405a-bff0-d2a796b22560 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.447119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0283c2-7fb6-4a32-933a-487ffc65a6c0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.451600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.452250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.452527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.452792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.471029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.473576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.488538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.489256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.489530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.489799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/21dcdde810504ecf963f7b4abc93270c/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.493682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=21dcdde810504ecf963f7b4abc93270c, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ce6688f0-053f-4f32-9380-e05d7c5daf9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:56.493794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:56.494726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:56.495651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:56.495651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:56.495651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:56.495829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.495903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 409/816] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:56.496441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89e19-3f06-4756-8fc0-57d4aa609c61 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.496441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89e19-3f06-4756-8fc0-57d4aa609c61 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.496694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89e19-3f06-4756-8fc0-57d4aa609c61 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.499460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 410/817] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:56.504062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.505341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.505341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.517993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 408/818] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:32:56 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/21dcdde810504ecf963f7b4abc93270c/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:32:56.518849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.528673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:56.529968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:56.562368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:56.566039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:56.626353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 411/819] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:32:56.657894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1aa9-14dd-4a8d-be16-36b853e80af6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.695423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.696033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.696300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.696562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.697384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:56.697621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.698984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.711015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 409/820] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:56.716352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.824825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71bfb3-8895-443d-9452-42b5b30ca700 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:56.859049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:56.859694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:56.859964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:56.860231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:56.867896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:56.869431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:56.880996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:56.881956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:56.882902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 412/821] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:56.888034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.905406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:56.929627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:56.988232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.004422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f89df-186e-4815-b0ba-0d14a5aba1b1 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.031122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cf788-5863-4ff4-8955-83a866dbe3d9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.041404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.042144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.042535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.042895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.044291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:57.044691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.046515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.070236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 410/822] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:57.071312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.072222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.073074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.073496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.073926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.074936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.077636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:57.089725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:57.091028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 15:32:57.092098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:57.096971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 413/823] 10.222.0.93 () {56 vars in 1129 bytes} [Wed Aug 24 15:32:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:32:57.100055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.186665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.188121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54156f8-2352-4f1b-aab8-40dbd68e4a78 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.215530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5393b-7964-4bbb-b4ed-48fb23be0e2b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.233800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.234502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.234849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.235268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.249753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.257619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.258464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.258746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.259014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.260053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:57.260355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.261814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.268268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 414/824] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:57.273920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.330380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.332250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.384982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa897af-4d9d-402f-88b3-9915fe3b671a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.420160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.420875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.421244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.421575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.422272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:57.422636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.424069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.434040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 415/825] 10.222.0.93 () {56 vars in 1124 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:57.435021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.447076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.466474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 411/826] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:32:57.471841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.515879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.568197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9969080-75d7-426b-a138-c471ea88389f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.575456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175e4a-56b0-4dfe-b4a6-59c85dd91ece None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.607764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.608375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.608648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.608927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.609709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.611180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.619090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.619728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.620002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.620522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.633304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.634927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.636278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 416/827] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:32:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:57.656307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:57.658543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:57.660668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:57.660668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:57.660668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:57.660668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 412/828] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:57.667841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.739501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.790013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b23bc-270e-492f-a04c-358f5550fdb5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.825712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.826700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.827170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.827729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.828562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:57.829081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:57.830652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701262e4-6fc7-4584-abe2-c008e0f6a4cd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:57.843324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 417/829] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:57.849113 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:57.947954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:57.958217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a4875-e86e-4764-9c29-3727259e52fc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:57.968829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e96-b257-4f75-88da-13a87d740681 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.969135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e96-b257-4f75-88da-13a87d740681 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.969405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e96-b257-4f75-88da-13a87d740681 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.971489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 418/830] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:32:57.976936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:57.976936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:57.977153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:57.995927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:57.997334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:57.998963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:57.999876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.000348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.000863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.008299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:58.010125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:32:58.021917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:58.022876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:32:58.024125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:58.026533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 413/831] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:58.031902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.079005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 419/832] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:32:58.148681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae22d-215c-4ab5-a830-eafd4df0b5e0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:58.183834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:58.184690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.185130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.185563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.186382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:58.186821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:58.188387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:58.201830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 414/833] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:58.208158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.261058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:58.311466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a40d5-1836-4226-8e8d-4230168d045a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:58.345646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:58.346169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.346439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.346705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.347428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:58.347727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:58.349178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940855-7fd2-483b-9fea-3eb3541aa976 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:58.356664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 420/834] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:58.367488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.385598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:58.479682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf19aa-7892-41be-9631-d99b8c4e822a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:58.518733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:58.519423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.519693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.519958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.533411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:58.538412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:58.539381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:32:58.540223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:58.542814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 415/835] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:58.544449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0cf9-01b2-4856-bd95-0c8966bcf303 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.544734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0cf9-01b2-4856-bd95-0c8966bcf303 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.545091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e0cf9-01b2-4856-bd95-0c8966bcf303 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.546565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 421/836] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:58.548620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.556405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.556405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.556405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.575258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:58.576541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:58.635407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:58.666761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616e26f-a625-4508-801c-fc355bb11318 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:58.677347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 422/837] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:32:58.707643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:58.708703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.709196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.709715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.710581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:58.711080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:58.712733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:58.721846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 416/838] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:32:58.727827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.776364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:58.835420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d32b3-10d6-45c5-a4ea-fb30c8a120d6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:58.870187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:58.871200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:58.871683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:58.872155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:58.882858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:58.884655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:58.900272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:58.901250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:58.902176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:58.902176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:58.902176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:58.904229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 423/839] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:58.910204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:58.944356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.031640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624084-9ae8-455c-b42e-56badee0d675 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.076841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.077845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.078364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.078636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.079536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:59.079841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.080751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.082885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.086769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.089047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f123-e10b-449f-9af6-6a98163110b0 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.131762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701efac-9353-492a-9d63-106711d0493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.132445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701efac-9353-492a-9d63-106711d0493e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.132733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701efac-9353-492a-9d63-106711d0493e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.133019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701efac-9353-492a-9d63-106711d0493e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.146039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701efac-9353-492a-9d63-106711d0493e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2701efac-9353-492a-9d63-106711d0493e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:32:59.152017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:59.153067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:59.154859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 424/840] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:59.166205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701efac-9353-492a-9d63-106711d0493e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.229918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 417/841] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:59.230839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.294424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701efac-9353-492a-9d63-106711d0493e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.335260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.335967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.336314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.336656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.337418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:59.337834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.339278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.348205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 425/842] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:59.351244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cba6d-64b7-4816-abb7-23c19e9d2f36 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.357910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.382979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.388976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.389618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.389895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.390162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.397963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.399721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:59.418709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:59.419658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:32:59.420609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:32:59.423454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 418/843] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:59.430106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.475384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31fc2-c3b6-48fb-8537-d35cfcc61bfa None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.501394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.520322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.521086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.521426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.521759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.533308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.534852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:32:59.549277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:59.550295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:32:59.551200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:32:59.551200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:32:59.551200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:59.555293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 426/844] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:59.556592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.559402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cb68-8734-4e4c-a598-f036335c2155 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.593883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.594936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.595213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.595478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.596437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:59.596678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.598298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.621353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 419/845] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:59.622390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.642531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.676466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989358db-f1fa-43be-a389-bed9f7571928 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.723382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.724113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.724391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.724772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.725472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:32:59.725772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.727181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422def0a-2ca2-4857-85d0-9fc8c31a9fb4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.739283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 427/846] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:32:59.740592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321021-9f61-4068-8c9f-4f1edf96448f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.740923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321021-9f61-4068-8c9f-4f1edf96448f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.741216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04321021-9f61-4068-8c9f-4f1edf96448f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.742544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 428/847] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:32:59.745729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04321021-9f61-4068-8c9f-4f1edf96448f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:32:59.759636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2246e7-800f-4eb3-9889-e07201a4b4fe None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.774965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.799840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.800545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.800821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.801097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.847484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04321021-9f61-4068-8c9f-4f1edf96448f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:32:59.877667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:59.878817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.880515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.884412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:32:59.885076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.885348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.885612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] PATH_INFO: `/v3/users/swift` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.893058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:32:59.894487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-c274bd36-b1a9-4c68-affb-10c1670dd0de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:32:59.907224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:32:59.908224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:32:59.909242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 429/848] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:32:59.909928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:32:59.909928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:32:59.910056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:32:59.928983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:32:59.930077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:32:59.995742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 420/849] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:32:59.996595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.004390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 430/850] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:32:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:00.006047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.014126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.122721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9da50-daf0-4a31-81ce-94386aa28dfe None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.136790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f0157-6dd8-4260-bcf7-f3303a073514 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.159567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.169762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.170690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.171183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.171651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.172766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:00.173363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.175192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.175613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.176360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.176708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.177072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.187932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.189442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.196382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 421/851] 10.222.0.93 () {56 vars in 1135 bytes} [Wed Aug 24 15:32:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:00.201791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:00.212114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:00.213433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:00.214319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:00.214319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:00.214319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.218002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 431/852] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:00.218861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.282285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.313702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc702ee8-626a-418f-9cf6-cd1c931abd43 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.322170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b8548-4848-42a9-9352-e3a7be3ccc96 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.348787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.349423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.349700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.349969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.354982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.355597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.355876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.356142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.356779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:00.357107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.358475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.369894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 432/853] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:00.370681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.401886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.418522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.419970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.469428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18de4a-2c26-4fb2-ad69-c4019bb8cf1f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.488221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.502990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.503625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.503899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.504168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.504751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.506237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-98bab578-fd40-4338-8b45-8daa6634f46b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:00.515196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:00.516365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.517319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 433/854] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:00.518307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df9b1-a1b3-4fba-a7db-339aa0e04645 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.518307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df9b1-a1b3-4fba-a7db-339aa0e04645 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.518307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485df9b1-a1b3-4fba-a7db-339aa0e04645 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.519235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 434/855] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:00.519918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df9b1-a1b3-4fba-a7db-339aa0e04645 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.524950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 422/856] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:33:00.524950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.617089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.621184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b39fb6-504f-4903-952f-ab2abbb1a7a0 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.624198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485df9b1-a1b3-4fba-a7db-339aa0e04645 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.654986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.655628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.655899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.656165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.656790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:00.657122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.657606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.658228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.658497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4764a-8d95-49f0-a0e0-ece78fec93a0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.658615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.658748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.662836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 423/857] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:00.663946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.664220 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.664491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.669079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.670541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:00.681965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:00.682923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:00.688631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.689127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:00.689209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 435/858] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:00.689279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:00.689349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.715446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.757093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 424/859] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:00.757929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.809956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209819-3fa2-45f0-bcaf-80c121dc8dbe None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.849625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.850484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.850934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.851357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.859761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd283-5f73-4a9b-ab12-cbc2470a89ec None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:00.863520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.865117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:00.880435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:00.881612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:00.882511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:00.882511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:00.882511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:00.882511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 436/860] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:00.882511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.894905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:00.899679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:00.900652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:00.900949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:00.901225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:00.901918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:00.902218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:00.903601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:00.908608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 425/861] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:00.909506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:00.955659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.019898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d38f-6874-4e50-b873-918219c25c3d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.049818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ac27f-14fe-46f5-a9bf-e8bdf440b246 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.062425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.063357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.063626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.064053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.064773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.065104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.066541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.080621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 437/862] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:01.082194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.092951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.093937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.094210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.094477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.095121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.095415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.096782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.113057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 426/863] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:01.114320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.152164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.188186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ea26-1e2c-4744-a6ba-96d52c7c42b4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.210349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.224958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38508-e08b-4126-b7f3-d4603c511061 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.230859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.231601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.231940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.232667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.233366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.235257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:01.245209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:01.246321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:01.247377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 438/864] 10.222.0.93 () {56 vars in 1132 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:01.248165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.264725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.265369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.265639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.265902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.266621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a75d087fed3c4c289db13b0344b3b422) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.266932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.268342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.274932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 427/865] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/role_assignments?user.id=a75d087fed3c4c289db13b0344b3b422&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:01.275777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.383491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a3d84-dfcd-40c0-871a-41952aea6eec None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.415549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b12a5-a67b-4711-a28a-1d12ac741965 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.425842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.434201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.435421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.435874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.436855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.447372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.449150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.460381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.461268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.461701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.462109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.463011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:01.463129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:01.464177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:01.465324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:01.466236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.468018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.469166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 439/866] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:01.470425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.474074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 428/867] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:01.479399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.505378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.596597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d46717-e027-4c8f-bdd4-b4e32f4cecf9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.617843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e29-6d55-46e5-bf8a-a84aca4d8b45 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.639588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.640207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.640485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.640755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.641876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.642190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.643638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.660236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 440/868] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:01.666920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:01.669920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.671739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.672223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.672700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.673577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.674165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.676136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210569d2-0eec-4220-9f9a-34c04bfa9d4b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.683136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 429/869] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:01.729328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:01.783800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc2d93-a853-4f48-b41e-ddca0937ae31 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:01.821383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:01.822493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:01.822858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:01.823238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:01.824990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=21dcdde810504ecf963f7b4abc93270c) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:01.824990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:01.826771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3ba61-4c9d-4100-9b1f-c054ef601969 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:01.833458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 441/870] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:01 2022] GET /identity/v3/role_assignments?user.id=21dcdde810504ecf963f7b4abc93270c&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:02.849412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc55e0-ff05-42fd-a3f8-b7cd4fa3f345 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:02.849973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc55e0-ff05-42fd-a3f8-b7cd4fa3f345 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:02.849973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc55e0-ff05-42fd-a3f8-b7cd4fa3f345 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:02.851541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 430/871] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:02.856912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3039-61ad-4d45-beef-fc4a21065bf7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:02.857325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3039-61ad-4d45-beef-fc4a21065bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:02.857517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda3039-61ad-4d45-beef-fc4a21065bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:02.875561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5bda3039-61ad-4d45-beef-fc4a21065bf7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:02.876742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5bda3039-61ad-4d45-beef-fc4a21065bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:02.948529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 442/872] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:03.224965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc55e0-ff05-42fd-a3f8-b7cd4fa3f345 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:03.315749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba179f3-c53c-45b0-a3c8-54b20c87d2d1 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.316019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba179f3-c53c-45b0-a3c8-54b20c87d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.316285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba179f3-c53c-45b0-a3c8-54b20c87d2d1 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.317928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 443/873] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:03.319589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:03.322977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ddc1-885d-487f-804a-8e6926b435d5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.323258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ddc1-885d-487f-804a-8e6926b435d5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.323528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9ddc1-885d-487f-804a-8e6926b435d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.339121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc55e0-ff05-42fd-a3f8-b7cd4fa3f345 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:03.343458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-77c9ddc1-885d-487f-804a-8e6926b435d5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:03.344640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-77c9ddc1-885d-487f-804a-8e6926b435d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:03.372022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:03.372631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.372978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.373250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.373904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:03.375333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fb718-321f-4c03-8a06-043040ee5ada None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:03.392308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 431/874] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:03 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:03.409310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:03.430902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 444/875] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:03.636535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7258c-2d23-4bc7-861d-ba14f117e58b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.636953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7258c-2d23-4bc7-861d-ba14f117e58b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.637217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7258c-2d23-4bc7-861d-ba14f117e58b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.638770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 432/876] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:03.647278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacd90-62bf-4efa-b0f0-4589bfbe7252 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.647278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacd90-62bf-4efa-b0f0-4589bfbe7252 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.647278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcacd90-62bf-4efa-b0f0-4589bfbe7252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.663684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4fcacd90-62bf-4efa-b0f0-4589bfbe7252 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:03.665236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4fcacd90-62bf-4efa-b0f0-4589bfbe7252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:03.703395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7258c-2d23-4bc7-861d-ba14f117e58b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:03.738023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 445/877] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:03.808168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7258c-2d23-4bc7-861d-ba14f117e58b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:03.842540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:03.843180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.843452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.843719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.856432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb0-ce31-4b13-982d-2269ed72f3d1 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.856608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:03.857070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb0-ce31-4b13-982d-2269ed72f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.857433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adbb0-ce31-4b13-982d-2269ed72f3d1 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.858809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 446/878] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:03.861201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:03.862307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:03.863678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 433/879] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:03.865384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:03.865384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:03.865666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:03.868178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:03.871140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:03.889236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:03.890362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:03.977922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 447/880] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:03.982676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717516-f8b4-443c-abcc-127081be0504 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.016871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.017552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.017822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.018085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.018752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:04.019050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.020619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.024361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.036559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 434/881] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:04.042371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.065518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.118601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.150555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42773-8224-4cc8-87d1-683dd1230915 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.162840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908b719-28fb-40e5-9dd2-00890917c36b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.193928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.194536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.194819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.195208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.195948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.197557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.198703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.199554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.200035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.200488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.218586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.218763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.229209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 448/882] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:04 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:04.238531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:04.239583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:04.241266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:04.241266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:04.241266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:04.241266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 435/883] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:04.246239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.254046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.375158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.378477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08000-9771-4c93-8ccc-b1919d57fc24 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.395122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8d7e-220d-41ba-a9c5-146fc70aaf4c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.405820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.430610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.431337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.431581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.431845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.432433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.433997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.437456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.438296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.438575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.439201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.439865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:04.440167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.443590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:04.448774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:04.450008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:04.450851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 436/884] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:04.453606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.454799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 449/885] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:04.460343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.566191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d53db-13b9-433c-a3f1-c7bf4ae81e91 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.590562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92649f9-b4ce-4f0f-b491-25b08a5f8f18 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.602441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.603469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.603990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.604453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.605401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:04.605897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.607460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.612811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 437/886] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:04.624960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.631819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.632457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.632729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.633052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.640923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.642610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:04.655568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:04.656580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:04.657593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:04.661186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 450/887] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:04.662572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.670382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.674861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.731678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6d4e-94f8-45f5-9796-d0e6a2082f93 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.769507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.770634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.771063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.771633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.772727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:04.773780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.775813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.778584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b6f-c684-484b-bbd8-3c43c980714c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.788932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 438/888] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:04.824789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:04.825471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:04.825748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:04.826015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:04.826802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:04.827272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:04.828764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:04.850097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 451/889] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:04.855943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:04.974330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490102-f9c8-4845-a503-6d02a5889a39 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:04.985147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.015776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.016397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.016671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.016968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.096635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.098131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b4a5f-c640-4afe-90cf-68bff1fe006d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.201749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 439/890] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:04 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:05.207951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.275494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.317558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706d58d-ebaa-4f90-b2de-6a711944befd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:05.343999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ceb5-5edf-49d6-9240-44c8ca6690b2 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.344335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ceb5-5edf-49d6-9240-44c8ca6690b2 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.344605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ceb5-5edf-49d6-9240-44c8ca6690b2 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.346252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 440/891] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:05.352946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.353390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.353500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.353857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.354144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.354414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.354679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.365604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.367051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.376566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:05.378205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:05.380405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:05.383022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:05.383977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:05.384977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:05.384977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:05.384977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:05.384977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 452/892] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:05.391393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.477130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 441/893] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:05.504400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac7ea-a2fa-4465-8b88-898b859aec5c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:05.522486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.540427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.541431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.541907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.542375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.543310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:05.543924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.545570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.557895 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 453/894] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:05.563803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.662893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba706-9e7c-4309-83c0-23db9925cf68 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:05.697909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.698964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.699456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.699957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.707283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.709007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.715136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:05.721900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:05.722896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:05.724600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 442/895] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:05.729322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.737939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.846765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4daca2-7366-4556-94bb-b7f6a41b10b4 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:05.857237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6f2e1-a1d3-4cfa-a864-d914a91148e4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:05.890831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.891480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.891757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.892255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.893280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.895149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.901367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:05.902157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:05.902500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:05.902839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:05.903652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:05.904025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:05.905388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:05.906371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:05.907228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:05.908181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:05.911143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 443/896] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:05.913614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.924951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 454/897] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:05.931014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:05.978148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.999074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:06.050743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10748-ab02-45f4-913c-12fb8a0525ae None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.051684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dccca2-88e3-4239-94b5-97f25401f970 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.087081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.088083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.088559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.089072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.090097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] RBAC: Adding query filter params (role.id=9c330ad4109341118ab34b4f27f07b21, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a75d087fed3c4c289db13b0344b3b422) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:06.090714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.092537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.093255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.093871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.094141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.094409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.095034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:06.095329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.097208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.104369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 444/898] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:06.109478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 455/899] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:05 2022] GET /identity/v3/role_assignments?user.id=a75d087fed3c4c289db13b0344b3b422&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=9c330ad4109341118ab34b4f27f07b21 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:06.111611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:06.226753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c501f-a585-43ac-9f00-00dfe11d4d13 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.255714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:06.265839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.266456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.266730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.266996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.267633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:06.267931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.269355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a185-9cd0-4d5a-8ae9-f892591ed694 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.275078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 445/900] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:06.280763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:06.288709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb4f2-dfe3-4d2a-94b3-3fe4da67b741 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.289044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb4f2-dfe3-4d2a-94b3-3fe4da67b741 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.289285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eb4f2-dfe3-4d2a-94b3-3fe4da67b741 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.290943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 446/901] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:06.296240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.296520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.296786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.317756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:06.319757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:06.385554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6ed9-258c-4153-9192-caea144c8c60 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.387531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:06.408096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 447/902] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:06.431669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.432462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.432807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.433172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.433947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] RBAC: Adding query filter params (interface=public, service_id=96683658684044888e06e4acd8076d34, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:06.434340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.435857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.442073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 456/903] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:33:06 2022] GET /identity/v3/endpoints?service_id=96683658684044888e06e4acd8076d34&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:06.447901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:06.554195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642a7d-89d8-4ffc-970e-1d1c7b14a248 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.574925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:06.589109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.589949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.590206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.590472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.591080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.592767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5aa7-8028-41a7-a600-f4276646b285 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.599210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 448/904] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:06 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:06.680400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:06.756004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd43d-0915-4172-96e3-12e7e802a50c None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.756683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd43d-0915-4172-96e3-12e7e802a50c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.757745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fd43d-0915-4172-96e3-12e7e802a50c None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.759862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 449/905] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:06.764670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.764974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.765246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.790872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:06.792296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:06.801118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e0b89-7e0f-4d04-a683-2a3497f8af0c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.836560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.837232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.837566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.837842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:06.838430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:06.839806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:06.849018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:06.850146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:06.851179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 457/906] 10.222.0.93 () {56 vars in 1132 bytes} [Wed Aug 24 15:33:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:06.855993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:06.877383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 450/907] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:06.892702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:06.963922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c0472-f2cd-48e1-b6fb-72fa793cd922 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:06.998247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:06.998866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:06.999135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:06.999407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:07.000103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:07.000404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:07.001825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:07.007120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 458/908] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:07.018036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:07.127819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee00bd-44e3-4411-b42d-bfedb8d2063d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:07.143083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:07.144845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:07.169213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:07.170257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:07.170746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:07.171221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:07.172284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:07.172592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:07.174326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:07.180883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 451/909] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:07.187229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:07.271495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:07.282405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1373b-bd61-4d20-8bdf-0096e3217399 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:07.315253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47e0d2-ed21-44a8-86d8-0093f83b063b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:07.325945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:07.326730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:07.326859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:07.327072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:07.327787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:07.329179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:07.356161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 459/910] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:07 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:07.365496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:07.366117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:07.366440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:07.366705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:07.367463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] RBAC: Adding query filter params (interface=public, service_id=5007c419428a4653872fe02692ef56b1, region_id=RegionOne) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:07.367767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:07.369462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924236fc-f70a-417c-9f41-9cdb802f4714 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:07.379406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 452/911] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:33:07 2022] GET /identity/v3/endpoints?service_id=5007c419428a4653872fe02692ef56b1&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:07.384842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:07.501381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1e11-d294-4a8d-86d8-3c65ee39b97f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:07.536065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:07.536674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:07.536971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:07.537233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:07.537877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:07.539205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac64f5-4a2a-4672-ada3-d2da5d744a79 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:07.546478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 460/912] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:07 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:08.115499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107fd8-3515-499e-9a73-c950350be8be None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.116037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107fd8-3515-499e-9a73-c950350be8be None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.116037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107fd8-3515-499e-9a73-c950350be8be None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.117654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 453/913] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:08.122791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44b5c-6ab6-496d-908f-0324f73fb7c6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.123073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44b5c-6ab6-496d-908f-0324f73fb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.123349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c44b5c-6ab6-496d-908f-0324f73fb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.142249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-97c44b5c-6ab6-496d-908f-0324f73fb7c6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:08.143442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-97c44b5c-6ab6-496d-908f-0324f73fb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:08.158426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:08.232487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 461/914] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:08.494025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107fd8-3515-499e-9a73-c950350be8be None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:08.538688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:08.604883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107fd8-3515-499e-9a73-c950350be8be None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:08.642444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:08.643133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.643404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.643670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.655315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:08.657648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de59c-2c79-4988-8d1e-af486fbacc13 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.658544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de59c-2c79-4988-8d1e-af486fbacc13 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.659018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de59c-2c79-4988-8d1e-af486fbacc13 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:08.659944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:08.660854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:08.662304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 454/915] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:08.663881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 462/916] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:08.668815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:08.669493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.669962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.670420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.688485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:08.690013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:08.760010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 463/917] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:08.774684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:08.777161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f24-2d90-4927-8dc6-3b8cfa85ab57 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:08.813255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:08.814265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.814732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.815202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.816051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:08.816552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:08.818264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:08.827183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 455/918] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:08.834036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:08.915792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:08.938152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a49cc-ef10-47a8-9fdc-f2574ba9bcdd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:08.972584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:08.973251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:08.973527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:08.973794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:08.984082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:08.985575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:09.000438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:09.001476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:09.003032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:09.003032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:09.003032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:09.003032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 464/919] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:09.007657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.024873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.135435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814992-4aad-4b89-8417-e13bc57a3d88 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.136005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b0ee9-35c1-4a1b-8322-9717a23c54df None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.171372 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.171989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.172256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.172529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.173260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:09.173495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.174871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.174980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.182468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.183431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.183899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.185027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.185819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.188228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.193227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 456/920] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:09.195824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:09.198730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:09.199773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 15:33:09.200619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:09.208117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 465/921] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:09.208564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.238212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.321905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679bb9c-e754-420b-a10c-fa66bb607191 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.347104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b27299-6d8f-46da-af33-d2f88a8a661b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.357563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.358179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.358451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.358718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.359347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:09.359644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.361058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896be348-e056-43d7-acde-281ff143fd0d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.370680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 466/922] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:09.370680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffe33-c47b-465b-a760-6ade50c4065d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.370680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffe33-c47b-465b-a760-6ade50c4065d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.370680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffe33-c47b-465b-a760-6ade50c4065d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.370680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 467/923] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:09.371738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ffe33-c47b-465b-a760-6ade50c4065d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.394127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.394768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.395041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.395308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.403902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.405877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-28ab7b3d-f336-4c54-9726-a5312d78443a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:09.417728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:09.418874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 457/924] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:09.419832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.420500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.420500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.438296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:09.439493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:09.441333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.485205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ffe33-c47b-465b-a760-6ade50c4065d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.505614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 458/925] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:09.506464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.518589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.520558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.521456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.521735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.522218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.522716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:09.523014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.524822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a11f9-0fc7-469f-914e-6923dafd8b9b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.534708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 468/926] 10.222.0.93 () {56 vars in 1114 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:09.534708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a92a-4e20-495c-9550-382f0dbea61e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.534708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a92a-4e20-495c-9550-382f0dbea61e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.534708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a92a-4e20-495c-9550-382f0dbea61e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.534708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 469/927] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:09.537952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786a92a-4e20-495c-9550-382f0dbea61e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.612372 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5da77-bdea-4a7d-8f2b-3a417ef34cfc None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.645097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786a92a-4e20-495c-9550-382f0dbea61e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.647208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.647834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.648430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.648695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.649438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:09.649995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.651421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491021-8c63-48f9-af27-fc3be2223477 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.669099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 459/928] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:09.670429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.670816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.671186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.673988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.686696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.687496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.687864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.688282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.689104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.689479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:09.690671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.690766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:09.724934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 470/929] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:09.724934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.784482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.799323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 460/930] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:09.800625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.846148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e19f-c82b-4972-90ff-d183df122f20 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.895522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.896220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.897532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.897532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.913349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.914823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:09.932262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:09.933340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:09.934775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:09.934775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:09.934775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:09.934775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 471/931] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:09.939802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:09.946118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd89a-c98f-4e4a-a3fa-a54b089bd07b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:09.975752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:09.993814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:09.994965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:09.995851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:09.996302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:09.997333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:09.999481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:10.010917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:10.011953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:10.012882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:10.014442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 461/932] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:10.021081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.057154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d8aac-dba4-414a-aaba-efa7d4e3a08d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.083893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.093596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.094218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.094497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.094768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.095438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.095739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.097154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.109244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 472/933] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.109882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.129422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d92d88-45f2-47a7-a922-54a8e59b68ad None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.163913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.165222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.165547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.165815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.166441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.166755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.168135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.176937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 462/934] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:10.176937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.215463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.227630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783fd6a-0855-46e0-9226-411168e15595 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.262765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.263417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.263693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.263963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.264873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.266286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:10.275307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:10.276271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:10.277241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 473/935] 10.222.0.93 () {56 vars in 1132 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:10.278063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.294983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebda5-d592-4fa6-84aa-aba07ca9d235 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.319106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.333718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.334354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.334724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.335488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.346069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.347802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:10.363024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:10.363957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:10.364891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 463/936] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:10.365959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.396318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad0dcb-ed31-42f6-a29d-5993bdc75200 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.437639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.438764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.438764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.438764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.439414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.439713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.441108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.451705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 474/937] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.452694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.467858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f755a4-9223-463c-aaae-2295c433b16c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.473092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.501477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.502090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.502362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.502627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.503251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.503566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.504921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.509442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 464/938] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.510221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.561304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.562181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e620ef-61b3-4441-95d7-83bbe3031d7d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.596177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.597028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.597479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.597889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.598715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.599155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.600731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.613076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 475/939] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.614028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.614133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba082-a43d-48c4-b21a-88c9b8e9b35f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.653296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.653916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.654184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.654450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.655282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] RBAC: Adding query filter params (interface=public, service_id=0218ebc8ee9d4ea6b055f3535aba7312, region_id=RegionOne) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.655594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.656996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.662562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 465/940] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/endpoints?service_id=0218ebc8ee9d4ea6b055f3535aba7312&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.663498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.701082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.723323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7b3c-c7d1-4bd1-82fd-5a8e9fd375ae None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.762132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.762812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.763090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.763362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.764049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:10.764357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.765759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.770004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed0ba-ab5b-439b-ab63-2c21a631dd0a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.770872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 476/941] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:10.774065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.783166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:10.809468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.810135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.810410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.810680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a75d087fed3c4c289db13b0344b3b422/roles/9c330ad4109341118ab34b4f27f07b21` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.813045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=a75d087fed3c4c289db13b0344b3b422, role_id=9c330ad4109341118ab34b4f27f07b21)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.814547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.829775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 466/942] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:33:10 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/a75d087fed3c4c289db13b0344b3b422/roles/9c330ad4109341118ab34b4f27f07b21 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:33:10.830676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:10.918602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f708997-74e7-4655-ba6b-32adb1ed931c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.966786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:10.967771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:10.968231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:10.968664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aef0c-4bf5-4630-8cf9-387d44fc190a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:10.968855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:10.969694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:10.972609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adb6cf-3df3-4ac0-b567-34600ba5fb78 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:10.980660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 477/943] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:10 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:11.013718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:11.014679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:11.015169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:11.015698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:11.016593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:11.018181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac301-334f-4073-9442-4bbd920967cd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:11.044601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 467/944] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:11.724640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458237fa-d915-4dfe-b256-079e8ab8fbe3 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:11.725241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458237fa-d915-4dfe-b256-079e8ab8fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:11.725241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458237fa-d915-4dfe-b256-079e8ab8fbe3 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:11.726699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 478/945] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:11.732239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:11.732650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:11.732849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:11.751563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:11.752757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:11.774099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:11.828308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 468/946] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:12.096006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458237fa-d915-4dfe-b256-079e8ab8fbe3 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:12.105957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:12.203800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458237fa-d915-4dfe-b256-079e8ab8fbe3 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:12.241542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:12.242166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.242443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.242712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.243374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:12.244864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:12.247531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING keystone.server.flask.common [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 15:33:12.266336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.sql.core [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:33:12.266336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 15:33:12.266336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [parameters: {'id': '2a30296c330142e99a1c0992f3a72bce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 15:33:12.266336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88171) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a30296c330142e99a1c0992f3a72bce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a30296c330142e99a1c0992f3a72bce. Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:33:12.283910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result.read() Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 15:33:12.284876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application yield resource Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise self.value Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application session.commit() Aug 24 15:33:12.286642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:33:12.288155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:33:12.290417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result.read() Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:33:12.292361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [parameters: {'id': '2a30296c330142e99a1c0992f3a72bce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:12.299896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:12.301878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a30296c330142e99a1c0992f3a72bce. Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:12.304091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 479/947] 10.222.0.93 () {60 vars in 1140 bytes} [Wed Aug 24 15:33:12 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:12.305514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:12.425065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ca78-90aa-48a1-8e4c-9fcf66fe53d0 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:12.475861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:12.476942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.477452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.477970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.485422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:12.487172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d7aa526a-effe-48ce-a69b-064433da2590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:12.499010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:12.500008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:12.501039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:12.503579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 469/948] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:12.509705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:12.582529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:12.617949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4afa-d5ae-4719-911a-cc3040c57579 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:12.652359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:12.652986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.653263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.653528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.654193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:12.654542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:12.656219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c846c-3b3f-4f23-a7d6-b5722b66a0b9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:12.676686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 480/949] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:12.844368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be559d-7359-4ad4-92c1-fac6b51ae7e5 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.845405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be559d-7359-4ad4-92c1-fac6b51ae7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.845896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be559d-7359-4ad4-92c1-fac6b51ae7e5 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.847945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 470/950] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:12.853678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8a41-f9e9-47fd-855f-6be5bed9e1c3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.854177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8a41-f9e9-47fd-855f-6be5bed9e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.854436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8a41-f9e9-47fd-855f-6be5bed9e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.874015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-867e8a41-f9e9-47fd-855f-6be5bed9e1c3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:12.875664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-867e8a41-f9e9-47fd-855f-6be5bed9e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:12.923358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aaa3-2e68-48b9-ae62-431203992958 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.923695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aaa3-2e68-48b9-ae62-431203992958 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.923896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927aaa3-2e68-48b9-ae62-431203992958 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.925504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 471/951] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:12.930558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282730e-4f9e-412f-9c75-0c3ba88f8e66 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:12.930767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282730e-4f9e-412f-9c75-0c3ba88f8e66 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:12.931064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282730e-4f9e-412f-9c75-0c3ba88f8e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:12.948816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1282730e-4f9e-412f-9c75-0c3ba88f8e66 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:12.949652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 481/952] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:12.952922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1282730e-4f9e-412f-9c75-0c3ba88f8e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:12.958455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.025105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 472/953] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:13.121942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eb48b-7550-4673-91d7-c83099a4458f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.122493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eb48b-7550-4673-91d7-c83099a4458f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.122984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1eb48b-7550-4673-91d7-c83099a4458f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.124740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 482/954] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:13.130131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.130586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.131008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.150310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:13.151734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:13.235364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 473/955] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:13.240185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1eb48b-7550-4673-91d7-c83099a4458f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.300255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.304793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.353654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1eb48b-7550-4673-91d7-c83099a4458f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.392557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.400686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.401365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.402223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.402680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.417471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:13.424461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:13.425580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:13.426492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 483/956] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:13.427238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffdc58-e6d2-4587-b38a-ff0d4d01fccc None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.433113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.468213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.468881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.469261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.469538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.470199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.471514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:13.480524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:13.481679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:13.482674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 474/957] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:13.488638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.547679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8eaea-7c5c-4b5f-b6c4-dc804432584e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.561776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.584887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.585806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.586175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.586499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.587305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:13.587682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.589339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.594774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388e86c-6a24-48ee-8c29-c8669ac39b58 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.598421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 484/958] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:13.599414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.630466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.631010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.631284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.631566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.632174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:13.632475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.633904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.635818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.644430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 475/959] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:13.645328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.708066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61852f5-fa48-45a9-9e5a-8b78b2e6e17b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.742249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.742920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.743494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.743494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.743993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.745386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.747756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cbba6-f99c-4667-8622-bfc9471dc89c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:13.754196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:13.755464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:13.756520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 485/960] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:13.757399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.786086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.786837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.787176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.787516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.798562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.800092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:13.815245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:13.816589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:13.817693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:13.817693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:13.817693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:13.817693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 476/961] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:13.817693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.881596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338819b-ae3d-437d-996b-4e67ed9a52d4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.886721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:13.916469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.917436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.917436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.917861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.918563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:13.918922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.920354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.930272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 486/962] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:13.930272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:13.944247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bfa8-897c-4297-a84d-c45b0ab364b8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:13.980324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:13.981012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:13.981285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:13.981708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:13.982607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:13.982916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:13.984282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:13.995196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 477/963] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:13.995196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.034694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb183b-d6da-4d8b-8c78-9eee44c8ed0d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.036358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:14.072504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.073145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.073420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.073687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.074400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:14.074703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.076160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.087809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 487/964] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:14.088692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.105194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c38a7-eb83-444b-9607-15586e22f2f4 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.122095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:14.141646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.142399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.142774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.143142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.143876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.145360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.171522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 478/965] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:14.172620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.218951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7aff-8829-43d4-a0da-169ad65b75b3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.265687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.266526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.266968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.267337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.268132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:14.268531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.270092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.281086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 488/966] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:14.324875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d7da7-b991-4de5-a25a-24992b6b3343 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.364274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.364992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.365261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.365528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.375562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.377175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:14.389861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:14.390909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:14.392457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 479/967] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:33:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:14.399889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.435208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:14.506011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9025b4d-06e7-4616-b852-1200ab7ebc64 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.542585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.543118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.543391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.543727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.544468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:14.544763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.546258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a3c2-c678-432b-b9fc-5cc278d9cd8e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.566189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 489/968] 10.222.0.93 () {56 vars in 1149 bytes} [Wed Aug 24 15:33:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:14.572410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.608792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:14.686630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f437-12a0-4d1b-ac6f-8f091186487e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:14.697368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44315-821b-457c-be0a-3d9075d22d70 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.697663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44315-821b-457c-be0a-3d9075d22d70 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.697909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44315-821b-457c-be0a-3d9075d22d70 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.699518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 490/969] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:14.704791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.705360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.705850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.724614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:14.725313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:14.725591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:14.725858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:14.727230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:14.728976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:14.809132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:14.810802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:14.824944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 491/970] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:14.847699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:14.924379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 480/971] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:14.929953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:14.942697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.035746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ad8f7-b92d-4e4c-bc72-3a590ebd9c9c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.069179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.069744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.070018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.070284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.080400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.081880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:15.096596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:15.097615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:15.098943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:15.098943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:15.098943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.098943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 492/972] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:15.105235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.114426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.178063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.218195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e449c-9f9f-4ed7-9a3f-ca821e8dfe73 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.227394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be188283-6dd9-4be8-a29e-35c16b14fbca None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.252682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.259449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.260334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.260843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.261418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.262417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:15.262921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.264110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.264718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.265056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.265328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.265768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.265963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.267610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.279300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 481/973] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:15.284214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.sql.core [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:33:15.284214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 15:33:15.284214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [parameters: {'user_id': '2066cb00112f4691ad8d6836a4e54d5e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 15:33:15.284214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88171) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 15:33:15.286149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result.read() Aug 24 15:33:15.291743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:33:15.292682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application yield resource Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application next(self.gen) Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise self.value Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application session.commit() Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 15:33:15.294008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.session.flush() Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application compat.raise_( Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 15:33:15.295274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 15:33:15.296197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application conn.query(q) Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application result.read() Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 15:33:15.297083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [parameters: {'user_id': '2066cb00112f4691ad8d6836a4e54d5e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:15.297958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 15:33:15.300665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 493/974] 10.222.0.93 () {60 vars in 1131 bytes} [Wed Aug 24 15:33:15 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:15.302745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.404512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da7331-8224-44f9-a5b9-7ecc541cf446 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.414913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29848c-8338-45f8-8e0e-452422e9925d None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.429539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.443205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.443855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.444158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.444382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.452305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.453961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.459365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.460236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.460728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.461233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:15.465725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:15.466734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 15:33:15.467713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:15.471685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 494/975] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:15.472506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.472821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.474485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:15.487218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:15.488189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:15.489190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:15.496322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 482/976] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:15.497800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.555196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.575848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5ab9b-8590-423e-a254-aef54216eebf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.608110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fa585-b9f4-4c3b-babd-c3887d7e5e64 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.611718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.612250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.612591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.613074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.613761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:15.614122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.615625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.645121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.646016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.646469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.646937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.647801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:15.648604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.650565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db23767-6fd8-4d47-a8d9-1e6ae325955b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.669167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 495/978] 10.222.0.93 () {56 vars in 1101 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:15.669668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 483/978] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:15.671389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:15.719782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.788032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbf17d-5253-408e-97e2-24577ae2d1cc None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:15.824961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:15.825575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:15.825853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:15.826125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:15.826854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] RBAC: Adding query filter params (role.id=9c330ad4109341118ab34b4f27f07b21, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=a75d087fed3c4c289db13b0344b3b422) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:15.827157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:15.828612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46980-487d-470e-9053-837ade23af77 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:15.835971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 496/979] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:15 2022] GET /identity/v3/role_assignments?user.id=a75d087fed3c4c289db13b0344b3b422&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=9c330ad4109341118ab34b4f27f07b21 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:16.166263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea20ab-4c8a-4dd8-900e-5bad1eef6174 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.166838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea20ab-4c8a-4dd8-900e-5bad1eef6174 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.166838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea20ab-4c8a-4dd8-900e-5bad1eef6174 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.168264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 484/980] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:16.173694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.174140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.174220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.192811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:16.194354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:16.249705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745e3f-5390-4d2d-97d3-67650854357b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.249957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745e3f-5390-4d2d-97d3-67650854357b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.250205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce745e3f-5390-4d2d-97d3-67650854357b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.251516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 485/981] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:16.256412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.256654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.257270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.272121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 497/982] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:16.276580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:16.277811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:16.345882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 486/983] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:16.533486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:16.568708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:16.607592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:16.636273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f6c81-3b72-43cd-8f1a-bf1e0e02ed0d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:16.649093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:16.672924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:16.674036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.674319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.674591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.675326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:16.676696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:16.685333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:16.686366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:16.687220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 498/984] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:16.692268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:16.711423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6cfb-1f33-4318-b908-d8ca6aa801cd None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:16.748585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:16.749318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.749502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.749759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.750397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:16.751757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:16.767870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 487/985] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:16 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:33:16.800989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:16.804469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956aea-0b3e-47de-a19b-a9460caaaeaf None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:16.851183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:16.851811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:16.852089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:16.852363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:16.853101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:16.853432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:16.854829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:16.860537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 499/986] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:16.866680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:16.979450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc11c-a814-4a58-bf83-4a01ddf619dd None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:16.981032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:17.018748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:17.019356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:17.019630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:17.019897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:17.020525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:17.020825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:17.022228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:17.027902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 488/987] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:17.033867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:17.139030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a8a8-39cd-4343-be40-8579c29f8dec None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:17.174477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:17.175137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:17.175421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:17.175623 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:17.176339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] RBAC: Adding query filter params (interface=admin, service_id=0218ebc8ee9d4ea6b055f3535aba7312, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:17.176646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:17.178052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68162c23-9550-4cf6-9998-7ad0622302ac None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:17.187986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 500/988] 10.222.0.93 () {56 vars in 1249 bytes} [Wed Aug 24 15:33:17 2022] GET /identity/v3/endpoints?service_id=0218ebc8ee9d4ea6b055f3535aba7312&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:17.189471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:17.300728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649028-50f7-4022-9e0c-d94d7e3ba9f5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:17.334280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:17.334879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:17.335153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:17.335419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:17.336009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:17.337468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abed86-1353-4fa0-9a1b-704f3ea66877 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:17.343968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 489/989] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:17 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:17.774896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885d09f-7786-4e2e-8515-bee2c564f956 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:17.775193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885d09f-7786-4e2e-8515-bee2c564f956 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:17.775423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885d09f-7786-4e2e-8515-bee2c564f956 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:17.776960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 501/990] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:17.782325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:17.782608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:17.782878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:17.800914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:17.802087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:17.826032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:17.872215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 490/991] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:18.132623 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885d09f-7786-4e2e-8515-bee2c564f956 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:18.160026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:18.242567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885d09f-7786-4e2e-8515-bee2c564f956 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:18.276868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:18.277525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:18.277794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:18.278061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:18.278640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:18.280101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:18.293106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:18.294150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:18.297397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 502/992] 10.222.0.93 () {56 vars in 1105 bytes} [Wed Aug 24 15:33:18 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:18.302408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:18.418553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610a30-9ab8-4d2d-85fe-ea45fffad305 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:18.452534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:18.453184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:18.453462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:18.453733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:18.454358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] RBAC: Adding query filter params (name=image) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:18.454657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:18.456032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c34021-eea4-4c32-aad1-60ebc4229ac4 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:18.461332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 491/993] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:18.466998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:18.555076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:18.568145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabccaef-dfa2-4a2d-987b-d2cfa2af8ea8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:18.602443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:18.603085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:18.603343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:18.603615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:18.604241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:18.604541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:18.605946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1993-bd9d-4f50-ac3b-763e2d7badd7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:18.610566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 503/994] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:18.712509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad4e7-ad48-4705-82ff-26fa80ac3725 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:18.712690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad4e7-ad48-4705-82ff-26fa80ac3725 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:18.713098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ad4e7-ad48-4705-82ff-26fa80ac3725 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:18.714579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 492/995] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:18.720662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:18.720924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:18.721234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:18.740578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:18.741780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:18.811442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 504/996] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:19.076720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad4e7-ad48-4705-82ff-26fa80ac3725 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.104858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:19.186228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ad4e7-ad48-4705-82ff-26fa80ac3725 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.232912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.233573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.233850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.234122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.234707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.236074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-43ce0f7c-1925-40bd-b990-e4e253ec7177 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:19.245531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:19.246581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:19.247473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.249018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 493/997] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:19.253210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.265286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c39e6-44b1-4e43-b80e-afb786a28888 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.265572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c39e6-44b1-4e43-b80e-afb786a28888 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.265847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c39e6-44b1-4e43-b80e-afb786a28888 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.267193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 494/998] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:19.272804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.273445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.274004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.292274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:19.293488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:19.338852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:19.358804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57eb9f-ab2c-4a4a-a3a4-6196cb4fa8b5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.368943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 495/999] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:19.396635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.397548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.397968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.398741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.399692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:19.400138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.401727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.406943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 505/1000] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:19.412742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.434841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:19.519007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726abc5-b445-4d31-a900-9a9a28da138f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.554022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.554687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.554968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.555239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.555902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:19.556216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.557635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.564971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 496/1001] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:19.569182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.629095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.678234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d7add-e145-4e4d-8caa-03288847a5ed None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.716366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.717014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.717295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.717603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.718312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] RBAC: Adding query filter params (interface=public, service_id=1664b855251d4b9599255d472a948cca, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:19.718611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.719840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:19.720016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.730324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 506/1002] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/endpoints?service_id=1664b855251d4b9599255d472a948cca&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:19.731494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.739667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121133-e9c3-4aa5-9d41-4d2146e4e402 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.744655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:19.775181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.775525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.775801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.776066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.776637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.778074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:19.786936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:19.787916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:19.789998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 497/1003] 10.222.0.93 () {56 vars in 1126 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:19.793835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:19.840726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628cdb5-14d0-4019-807f-5c97f512e576 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.876349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.877293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.877743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.878002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.878650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.880230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.887052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 507/1004] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:19.902235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022abb5-f62a-4db1-86f3-29b0804d3967 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:19.941154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:19.941777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:19.942045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:19.942306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:19.942940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:19.943235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:19.944609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:19.950930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 498/1005] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:19.956521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:20.043035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:20.069357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b7dd-79f6-4908-a07c-4cc902067a70 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:20.104230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:20.107048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:20.107676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:20.108157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:20.109044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:20.109598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:20.111163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83ef5f-1942-40d8-9231-c0d3667521d3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:20.116986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 508/1006] 10.222.0.93 () {56 vars in 1122 bytes} [Wed Aug 24 15:33:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:20.122572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:20.137735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:20.235014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bafd40-db22-42cf-8910-1437a066e6f7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:20.269931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:20.270535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:20.270805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:20.271066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:20.271731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:20.273450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c3c9c-59a3-4f39-b8a8-06e03ac1cb4f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:20.296941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 499/1007] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:33:20.499835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac8ad-7e8f-416d-946c-c5e7b9662379 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:20.500409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac8ad-7e8f-416d-946c-c5e7b9662379 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:20.500409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac8ad-7e8f-416d-946c-c5e7b9662379 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:20.501939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 509/1008] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:20.507045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5615-3ada-4a18-bf54-45c8efc708fc None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:20.507499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5615-3ada-4a18-bf54-45c8efc708fc None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:20.507590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5615-3ada-4a18-bf54-45c8efc708fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:20.526363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4ffe5615-3ada-4a18-bf54-45c8efc708fc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:20.527547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4ffe5615-3ada-4a18-bf54-45c8efc708fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:20.590799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:20.602262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 500/1009] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:20.862381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac8ad-7e8f-416d-946c-c5e7b9662379 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:20.972974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac8ad-7e8f-416d-946c-c5e7b9662379 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:21.011285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:21.011894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:21.012166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:21.012433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:21.013128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:21.014498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773958c-08e1-4fff-b57c-720611f04787 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:21.024890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:21.038481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 510/1010] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:20 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:21.832236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b626-4e34-4a01-b83d-4cfba7a7279b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:21.832818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b626-4e34-4a01-b83d-4cfba7a7279b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:21.832818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b626-4e34-4a01-b83d-4cfba7a7279b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:21.834314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 501/1011] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:21.839478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cad01-ecb8-4fcf-9fc6-c7d98a7cdd2d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:21.839890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cad01-ecb8-4fcf-9fc6-c7d98a7cdd2d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:21.839988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cad01-ecb8-4fcf-9fc6-c7d98a7cdd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:21.858214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-490cad01-ecb8-4fcf-9fc6-c7d98a7cdd2d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:21.859381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-490cad01-ecb8-4fcf-9fc6-c7d98a7cdd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:21.935957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 511/1012] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:22.200509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109b626-4e34-4a01-b83d-4cfba7a7279b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.200935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe648-0c6d-4dc2-8d16-02b748e4f6e9 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.201224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe648-0c6d-4dc2-8d16-02b748e4f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.201514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efe648-0c6d-4dc2-8d16-02b748e4f6e9 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.203100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 512/1013] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:22.208068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.208339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.208604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.228792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:22.230090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:22.305052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 513/1014] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:22.313706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109b626-4e34-4a01-b83d-4cfba7a7279b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.346580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.347205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.347481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.347747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.348325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.349727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:22.358506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:22.359566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 15:33:22.360475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:22.365415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 502/1015] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:22.366808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.427552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:22.473013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16da7-a645-4bda-864b-07e15c443bbd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.508164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.508765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.509090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.509357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.509976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:22.510272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.511629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.516847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 514/1016] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:22.522726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.562347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.585733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:22.630854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdf698-5a3d-433d-ae07-b2bc834baab7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.667665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.668493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.668929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.669371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.670272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:22.670865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.672367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.678390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 503/1017] 10.222.0.93 () {56 vars in 1112 bytes} [Wed Aug 24 15:33:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:22.679361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be91cc-830f-4ec8-8e08-bc491a7c6fa1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.684548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.701863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:22.720547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.721516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.721627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.721831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.722920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.724408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.726127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 515/1018] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:22.731692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:22.800502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe6bb2-c0da-4896-9c39-928de63fad51 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.834013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:22.843439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ee4b2-b7ad-47d5-9be0-d196e023c832 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:22.846940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.847582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.847857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.848120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.848797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.850180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e3e5-5155-44a5-a945-df367c70a987 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.874649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 504/1019] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:22.899823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:22.900454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.900727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.900993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.901699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:22.903190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5d527-8e5f-42eb-af11-0ba24ae452d7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:22.939312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 516/1020] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:22 2022] POST /identity/v3/projects => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:22.943022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de55f1-0aa8-4491-9a8b-e08cca40bec1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.943328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de55f1-0aa8-4491-9a8b-e08cca40bec1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.943583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de55f1-0aa8-4491-9a8b-e08cca40bec1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.945190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 505/1021] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:22.951585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff264e-254d-4426-99b3-82601428314e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:22.951875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff264e-254d-4426-99b3-82601428314e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:22.952189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff264e-254d-4426-99b3-82601428314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:22.972630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e9ff264e-254d-4426-99b3-82601428314e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:22.973897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e9ff264e-254d-4426-99b3-82601428314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:23.007404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:23.058357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 517/1022] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:23.329048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de55f1-0aa8-4491-9a8b-e08cca40bec1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:23.449521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de55f1-0aa8-4491-9a8b-e08cca40bec1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:23.495199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:23.495864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:23.496139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:23.496405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] PATH_INFO: `/v3/services/image` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:23.497023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:23.498410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:23.508482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:23.509909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:23.514097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 506/1023] 10.222.0.93 () {56 vars in 1105 bytes} [Wed Aug 24 15:33:23 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:23.518480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff264e-254d-4426-99b3-82601428314e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:23.637475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff264e-254d-4426-99b3-82601428314e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:23.671735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:23.672346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:23.672642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:23.672886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:23.673550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] RBAC: Adding query filter params (name=image) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:23.673849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:23.675216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:23.680359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 518/1024] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:23.686014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:23.733393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:23.789756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af9331-ac62-44ff-aee5-dce9ee4ba57f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:23.824729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:23.825416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:23.825696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:23.825961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:23.826624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] RBAC: Adding query filter params (type=image) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:23.826943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:23.828386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:23.833864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 507/1025] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:23.839981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:23.868576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:23.941198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388685a-95c1-4895-82ae-b5697edf1773 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:23.974842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:23.975453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:23.975726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:23.975992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:23.976698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] RBAC: Adding query filter params (interface=public, service_id=2aa800d386b14734a000e2c5fb969377, region_id=RegionOne) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:23.977031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:23.978489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c4055-c849-4146-bdef-b629b3e9bb3c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:23.984137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 519/1026] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:33:23 2022] GET /identity/v3/endpoints?service_id=2aa800d386b14734a000e2c5fb969377&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:23.990273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:24.097719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d34d5-7377-4504-9cf3-296a1e36c06c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:24.110188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:24.140149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:24.140755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:24.141057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:24.141322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:24.141921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:24.143288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26337bce-eaac-48c7-8b61-3dc7058d7d3a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:24.157168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 508/1027] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:33:23 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:33:24.929174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994425-41ae-4801-9635-1070579e0d80 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:24.929751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994425-41ae-4801-9635-1070579e0d80 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:24.929751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994425-41ae-4801-9635-1070579e0d80 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:24.931057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 520/1028] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:24.931850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e5ab-e850-45e3-8e73-c8ce8a6be00f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:24.932273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e5ab-e850-45e3-8e73-c8ce8a6be00f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:24.932548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e5ab-e850-45e3-8e73-c8ce8a6be00f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:24.933927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 509/1029] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:24.936133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:24.936394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:24.936682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:24.940681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:24.941020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:24.941295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:24.954768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:24.955949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:24.959544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:24.960703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:25.025615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 521/1030] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:25.036261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 510/1031] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:25.291596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.302489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.316794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:25.391837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6696e-d817-4b96-9707-6fef16e9f968 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.401878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45acf3b-c1de-4bf4-9bfd-eb588c824205 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.403402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:25.426942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.427574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.427850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.428120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.437838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.438236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:25.438483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.438757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.439024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.440126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:25.441589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:25.442902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:25.443816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:25.444676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:25.448305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 511/1032] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:25.448860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 522/1033] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:25.449305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.449679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.530316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:25.551166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae45cf-0642-40dc-b5f4-88d1873ba651 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.551753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92561-3b72-46d7-81c9-ad2b10706e36 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.587674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.588114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.588351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.588588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.588777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.588882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.589066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.589348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.589566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:25.590012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:25.590314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:25.591039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:25.591845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:25.605386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 523/1034] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:25.606476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.621040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 512/1035] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:33:25 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:25.730057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b16937-d57f-4302-b115-76a56e67d6b6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.771462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.771462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.771775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.772019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.784215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:25.786130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:25.788321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:25.801463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:25.802484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:25.803408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:25.803408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:25.803408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:25.803408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 524/1036] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:25.808696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:25.839817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:25.917339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01618b9-d113-4500-8fb0-bc5c19fd0ab5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:25.952951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:25.953630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:25.953903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:25.954169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:25.954837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:25.955137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:25.956502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165025-3851-4def-bc6f-ff20632c15a0 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:25.970148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 513/1037] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:25.975712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.064435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519f7-6846-450f-a389-ef447265f42f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.065104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519f7-6846-450f-a389-ef447265f42f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.065104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45519f7-6846-450f-a389-ef447265f42f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.066407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 514/1038] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:33:26.071742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.072047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.072311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.083269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad0cd-cf1b-4afa-a524-520e0813c9fc None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.093083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:26.094456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:26.119474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.120109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.120385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.120653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.128588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.130270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:26.142530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:26.143713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:26.144676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 525/1039] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:33:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:26.150638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.167976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 515/1040] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:26.212523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.261445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ab710-7dfb-43f9-b9e8-81122e506d74 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.295648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.296256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.296527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.296792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.297548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:26.297850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.299290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.317665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 526/1041] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:26.324103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.343325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.427702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122120-107f-43f4-a7ae-1dbe8962a31f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.429868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.463407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.464012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.464284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.464550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.533822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.535285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.553863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.557219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e74601-65bf-49dc-ac70-9a444b65da97 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.573462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.596138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.596778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.597067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.597343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] PATH_INFO: `/v3/services/image` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.597956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.599321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:26.608916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:26.610021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:26.614106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 527/1042] 10.222.0.93 () {56 vars in 1105 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:26.616246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.643846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 516/1043] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:26.649771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.731812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc1ec-aa1b-47d2-9888-e76db22332ea None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.756555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85aff3-9a39-4109-a977-86e0094098a3 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.766197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.766812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.767093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.767365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.767987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:26.768283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.769766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.775378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 528/1044] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:26.776142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.781261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.802128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.803078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.803517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.804009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.815199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.816917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.824991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:26.833132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:26.834139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:26.835054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:26.835054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:26.835054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:26.835054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 517/1045] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:26.839828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.890461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8d43-b145-4a41-a9fb-c9d32ed7b0f9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.925211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.925826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.926101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.926369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.926995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:26.927295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.928664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.934474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 529/1046] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:26.939938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:26.945735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b6f4-32ba-4123-9fcd-cd60d5d40e97 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:26.980432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:26.981064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:26.981340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:26.981939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:26.982335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:26.982650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:26.984204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:26.997727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 518/1047] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:27.003515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:27.041607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:27.043542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316dc00-a0ab-468a-86ef-d9ab79cf06c9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:27.051193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:27.082953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:27.083620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.083877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.084146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.084807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:27.086199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:27.116932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 530/1048] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:33:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:33:27.119737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f661c99-32d4-43f8-9781-8aa074d69436 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:27.170150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:27.170798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.171072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.171354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.179430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:27.180953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:27.193557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:27.194558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:27.195468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 519/1049] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:27.200989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:27.329465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c7db4-0879-485b-bb78-8ede1a978d3d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:27.363359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:27.363949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.364222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.364485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.365202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:27.365492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:27.366935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9efe9-64e0-46aa-aa7c-aac5d83a192c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:27.379328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 531/1050] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:27.385370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:27.475206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:27.492664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f87be-9396-46db-90ba-fbe8d0a91910 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:27.526672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:27.527276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.527550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.527814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.528530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] RBAC: Adding query filter params (role.id=9c330ad4109341118ab34b4f27f07b21, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:27.528834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:27.530357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7540e87-1941-4c32-b6ae-2cacdf0b2055 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:27.544935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 520/1051] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:27 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=9c330ad4109341118ab34b4f27f07b21 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:27.619812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88721-8fe5-4b75-a044-79f1064a3c64 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.620002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88721-8fe5-4b75-a044-79f1064a3c64 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.620249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b88721-8fe5-4b75-a044-79f1064a3c64 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.621844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 532/1052] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:27.627587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:27.627908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:27.628098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:27.647507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:27.649077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:27.720433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 521/1053] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:27.985393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88721-8fe5-4b75-a044-79f1064a3c64 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:28.012355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:28.132017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b88721-8fe5-4b75-a044-79f1064a3c64 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:28.190791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:28.191801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:28.192256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:28.192732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:28.211750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:28.217059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:28.218062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:28.218914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:28.223141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 533/1054] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:28.224435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:28.316851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:28.340232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4ee7-02c1-4bcd-b68d-55d48bb3389a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:28.377433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:28.378044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:28.378317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:28.378592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:28.379256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:28.379561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:28.380945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:28.389691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 522/1055] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:28.395464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:28.478128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:28.497885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a74c-8f40-4227-a455-50d8a726720c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:28.533270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:28.533962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:28.534241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:28.534507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] PATH_INFO: `/v3/users/577106949c574006a6fa170d33187d86` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:28.549432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] RBAC: Authorizing `identity:get_user(user_id=577106949c574006a6fa170d33187d86)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:28.550977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:28.553040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 534/1056] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:28 2022] GET /identity/v3/users/577106949c574006a6fa170d33187d86 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:28.559371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:28.668163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f0e59-1652-4823-af59-bed5d56fcb7a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:28.703243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:28.703841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:28.704095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:28.704367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:28.715271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:28.775300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:28.776746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:28.882542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 523/1057] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:28.884529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:28.988943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9717d9-9b01-4953-8603-7f2417f84e6a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:29.024018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:29.024713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.025022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.025297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.026470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:29.027980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cebc0-6bbf-455f-9320-93cea299c775 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:29.029998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 535/1058] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:28 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:29.037054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:29.082302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:29.118310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e030e7b-898a-4ed8-a12c-7e7582733f14 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.118586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e030e7b-898a-4ed8-a12c-7e7582733f14 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.118865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e030e7b-898a-4ed8-a12c-7e7582733f14 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.120214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 536/1059] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:29.125255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a50b-770d-4c4d-9bfb-952306613d6b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.125535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a50b-770d-4c4d-9bfb-952306613d6b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.125805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128a50b-770d-4c4d-9bfb-952306613d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.146046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b128a50b-770d-4c4d-9bfb-952306613d6b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:29.146994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402faf5-aa94-49d3-9a44-9a0487a0cfdf None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:29.147249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b128a50b-770d-4c4d-9bfb-952306613d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:29.150516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:29.186267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:29.187036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.187312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.187578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.189123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=70d8098e4ab745e99563d8804c15eb21, user.id=577106949c574006a6fa170d33187d86) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:29.189430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:29.190864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db3b0-67ba-4139-be89-66143727e201 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:29.198129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 524/1060] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:29 2022] GET /identity/v3/role_assignments?user.id=577106949c574006a6fa170d33187d86&scope.project.id=70d8098e4ab745e99563d8804c15eb21&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:29.231365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 537/1061] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:29.419243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbe05-7873-405d-a7c3-f6c6a079438b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.419804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbe05-7873-405d-a7c3-f6c6a079438b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.419804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cbe05-7873-405d-a7c3-f6c6a079438b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.421361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 525/1062] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:29.426514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.426801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.427072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.446465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:29.447638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:29.501237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cbe05-7873-405d-a7c3-f6c6a079438b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:29.515308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 538/1063] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:29.603089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cbe05-7873-405d-a7c3-f6c6a079438b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:29.605569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:29.643452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:29.644062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.644339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.644604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.713103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:29.714472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:29.776565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:29.821648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 526/1064] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:33:29.827596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:29.832142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:29.847365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:29.884196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d033d-d49e-4258-9f6c-681e9cb82ad2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:29.919856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:29.920607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.920884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.921191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.932115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:29.932280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a4b4-6764-456c-85e3-716342e390e6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:29.937094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:29.938029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:29.942007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 539/1065] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:29.944449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:29.969501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:29.970058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:29.970331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:29.970599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:29.983145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:29.984583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:30.000796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:30.002531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:30.004057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:30.004057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:30.004057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:30.004057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 527/1066] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:30.008099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.062026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e103b-6475-429a-b02b-e703714fd472 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.078448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:30.094148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:30.102512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.103118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.103486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.103813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.104479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:30.104776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.106180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.114579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 540/1067] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:30.120041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.126342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f93d72-b117-44bd-aa91-70eac4636439 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.162844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.163457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.163734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.164007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.164655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:30.165045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.166552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.179824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 528/1068] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:30.236809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e866a-5fda-4c1b-9e23-ba9b60ee556e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.276333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.277007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.277285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.277545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.289683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.291204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:30.306971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:30.308056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:30.309568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:30.309568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:30.309568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:30.313214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 541/1069] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:30.314173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.437360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce72e7-feed-4986-acae-37d4c4b438ed None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.457285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:30.476876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.477475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.477750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.478020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.478668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:30.478967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.480419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.492562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 529/1070] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:30.498398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.541749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:30.598017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfe03b-ce62-420e-96cc-ce775bd65e12 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.632324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.632983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.633249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.633513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.641946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.643383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:30.654722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:30.655719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:30.656670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 542/1071] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:30.661832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.771498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e323a-e681-4559-847f-99f06230054c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.807153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.807758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.808035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.808302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.809049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:30.809337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.810761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:30.828315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 530/1072] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:30.834353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:30.936521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41bc8d-cbbc-4e5e-b568-fe34795cba7c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:30.938263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:30.974591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:30.975215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:30.975490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:30.975765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:30.986466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:30.987923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-f114011f-6fa0-4708-926c-a2ce1ff24f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:31.002054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:31.003050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:31.003951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:31.003951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:31.003951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:31.003951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 543/1073] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:31.009371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.044801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:31.074157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef8374-831e-48b7-bebe-ea70e80e86e8 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.074435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef8374-831e-48b7-bebe-ea70e80e86e8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.074705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef8374-831e-48b7-bebe-ea70e80e86e8 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.076080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 544/1074] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:31.080999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.081277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.081538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.099295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:31.100477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:31.115731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1ba8a-688c-412f-88e8-f09e25786320 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.150773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.151384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.151658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.151929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.152566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:31.152866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.154300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.165909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 531/1075] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:31.167738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 545/1076] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:33:31.171772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.267561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:31.275478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a9cf6-d2bd-4146-891c-9e9615a535d8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.311295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.311843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.312113 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.312380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.318992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.320469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:31.331630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:31.332785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:31.333937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 532/1077] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:31.341333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.429651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:31.430875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.446039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df59ee-42a2-48a5-835d-7e4d8752c379 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.480167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.480794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.481101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.481379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.482071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:31.482376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.483828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.495179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 546/1078] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:31.501205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.531303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0abe-dc8d-4033-8073-77ea7cf4fa65 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.566618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.567218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.567515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.567785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.578917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:31.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:31.584696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:31.585614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:31.589096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 533/1079] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:31.590721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.598988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5344f-ec83-40f2-a70a-a0d8015b35ee None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.608215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:31.632587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.633292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.633561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.633872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/9c330ad4109341118ab34b4f27f07b21` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.636025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=79b6528e8e264539aae69a23f7e2b4e0, role_id=9c330ad4109341118ab34b4f27f07b21)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.637500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.650794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 547/1080] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:33:31 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/79b6528e8e264539aae69a23f7e2b4e0/roles/9c330ad4109341118ab34b4f27f07b21 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:33:31.705777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44ffb-a1af-415b-829b-44bce6d92faa None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.743991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.744615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.744893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.745187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.745885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:31.746186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.747569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.757466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 534/1081] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:31.763825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:31.767916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:31.874826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779c20-5eaa-4d4c-8b1a-644d8a1fb837 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:31.909372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:31.910006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:31.910279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:31.910545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] PATH_INFO: `/v3/users/577106949c574006a6fa170d33187d86` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:31.911670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] RBAC: Authorizing `identity:get_user(user_id=577106949c574006a6fa170d33187d86)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:31.913141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:31.915069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 548/1082] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/users/577106949c574006a6fa170d33187d86 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:31.921167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:32.003129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:32.027985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca6d42-2b6c-4bf5-9ba4-03e34ae0c6ec None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:32.062786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:32.063414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:32.063685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:32.063954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:32.065154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:32.066627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e21f8-f72b-4d57-9a12-b10cc7c2c61d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:32.068291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 535/1083] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:31 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:32.074425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:32.150538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:32.184170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30783de2-f044-4262-be75-a1f605b76daa None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:32.219854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:32.220890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:32.220890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:32.221156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21/users/577106949c574006a6fa170d33187d86/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:32.223086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d8098e4ab745e99563d8804c15eb21, user_id=577106949c574006a6fa170d33187d86, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:32.224528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbb33-9376-4c22-bf58-524550b71048 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:32.238852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 549/1084] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:33:32 2022] PUT /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21/users/577106949c574006a6fa170d33187d86/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:33:33.518376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779a15-a8db-4673-a694-949819387e43 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:33.519019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779a15-a8db-4673-a694-949819387e43 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:33.519019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779a15-a8db-4673-a694-949819387e43 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:33.520284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 536/1085] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:33.526465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:33.526890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:33.527062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:33.546060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:33.547293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:33.619202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 550/1086] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:33.881242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9779a15-a8db-4673-a694-949819387e43 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:33.988749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9779a15-a8db-4673-a694-949819387e43 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.024547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.025187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.025454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.025713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.035916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-26057103-70a7-4087-99fa-0d612b4d9c3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:34.040632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:34.041675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:34.042544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 537/1087] 10.222.0.93 () {56 vars in 1120 bytes} [Wed Aug 24 15:33:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:34.047934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.110141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.148624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f9e8-211b-458c-a33f-bde83bb94cbe None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.148826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f9e8-211b-458c-a33f-bde83bb94cbe None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.149151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07f9e8-211b-458c-a33f-bde83bb94cbe None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.150495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 538/1088] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:34.150885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667ca4-5114-44ab-9816-0a5ade498afe None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.155664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.155950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.156216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.165729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.176601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:34.177992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:34.190611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.191249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.191530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.191821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.192505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:34.192811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.194309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.202573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 551/1089] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:34.210043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.247024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 539/1090] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:34.309292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490493f-2af1-491d-8e0d-ace75028fb58 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.332121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.343594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.344220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.344487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.344751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.355271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.356722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:34.370673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:34.371641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:34.372551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:34.372551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:34.372551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:34.372551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 552/1091] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:34.377838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.482817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210d673-8d00-4694-b175-8edc35a8cf1c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.510815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.517650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.518312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.518594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.519197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.519520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:34.519824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.521319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.523557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.534790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 540/1092] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:34.540522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.611642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae6d1a-6dca-4146-8b31-469eea03287c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.638308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e576e54-bebe-4676-b5c6-2df7d30f0fe5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.647679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.648612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.648879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.649170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.659575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:34.664267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:34.665374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:34.666418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 553/1093] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:34.671715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.675826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.676460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.676729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.677020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.684696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.686230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:33:34.698085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:34.699107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:34.700100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 541/1094] 10.222.0.93 () {56 vars in 1093 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:34.704928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.711107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.760294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.775724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cb9f-7fc2-4bfe-bea7-6302d335364e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.806794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ece73-6eb5-4a2a-96f2-3de58ad1b817 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.809991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.810632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.810900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.811164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.811822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:34.812125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.813524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.822753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 554/1095] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:34.829138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.843596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.844257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.844527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.844797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.845601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:34.845907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.847396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.865940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 542/1096] 10.222.0.93 () {56 vars in 1133 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:34.872206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.926103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.930497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e35d-f9ea-498c-800a-749bc4db5af4 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.964315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:34.965000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:34.965281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:34.965553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] PATH_INFO: `/v3/users/577106949c574006a6fa170d33187d86` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:34.966768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] RBAC: Authorizing `identity:get_user(user_id=577106949c574006a6fa170d33187d86)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:34.968284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:34.970104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 555/1097] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/users/577106949c574006a6fa170d33187d86 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:34.974042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1621e-051a-4094-b9b4-f3774f37b1f7 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:34.976056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:34.987177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.009879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.010555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.010775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.011072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.074378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fdb19-2205-493f-9855-2fc7206b1a04 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.077292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.078829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.108852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.109539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.109814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.110078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.143768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.177874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.179339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.180217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 543/1098] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:33:35.186133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.199697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.282862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 556/1099] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 15:33:35.289556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.291268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f5e5-705e-46fa-9fac-8d7a9de24a2a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.324633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.325287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.325558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.325822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.335926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.337487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:33:35.351577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:35.352783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:33:35.354008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:33:35.354008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:33:35.354008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:35.354008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 544/1100] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:33:35.354856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.358676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.389651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2c7ab-9350-48c8-9ec4-c21c5692a89a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.420190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.424500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.425177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.425449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.425715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.426824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.428264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.430097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 557/1101] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:35.436221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.460833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e457f-d341-4388-9653-f93102b7c367 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.493629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.494276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.494549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.494785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.495445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:35.495741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.497114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.509186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 545/1102] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:35.515158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.535819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3fee-9a86-4f16-8cf7-bdf134d0e2ca None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.570114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.570771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.571044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.571424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.572217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=70d8098e4ab745e99563d8804c15eb21, user.id=577106949c574006a6fa170d33187d86) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:35.572516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.574073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.575783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.580874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 558/1103] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/role_assignments?user.id=577106949c574006a6fa170d33187d86&scope.project.id=70d8098e4ab745e99563d8804c15eb21&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:33:35.628169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f2331-501d-4845-9ff0-2da1b75ea533 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.655320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.667959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.668614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.668885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.669177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.676970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.678465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:33:35.690760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:35.691981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:33:35.692960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 546/1104] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:35.698468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.808038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaecf5-2420-47d8-aafa-f8893f826e2a None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:35.842978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:35.843594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:35.843868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:35.844132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:35.844822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:35.845157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:35.846596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad6c4d-494a-42f2-adbf-3bd19c63c5c1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:35.858855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 559/1105] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:35.865129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:35.971882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1a65-a0db-4430-aed7-88c0bdebc393 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:36.007672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:36.008279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:36.008561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:36.008852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:36.009604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] RBAC: Adding query filter params (role.id=9c330ad4109341118ab34b4f27f07b21, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=79b6528e8e264539aae69a23f7e2b4e0) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:36.009909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:36.011348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21221b2a-a838-428e-abec-1023e6e6b9cf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:36.017531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 547/1106] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:35 2022] GET /identity/v3/role_assignments?user.id=79b6528e8e264539aae69a23f7e2b4e0&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=9c330ad4109341118ab34b4f27f07b21 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:37.494653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9612-61e3-419c-a776-06a1f56afd98 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:37.495550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9612-61e3-419c-a776-06a1f56afd98 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:37.495550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c9612-61e3-419c-a776-06a1f56afd98 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:37.497755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 560/1107] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:37.504154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:37.504884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:37.505054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:37.531204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:37.532392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:37.577899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:37.604400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 548/1108] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:37.868085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c9612-61e3-419c-a776-06a1f56afd98 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:37.936760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:37.981325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c9612-61e3-419c-a776-06a1f56afd98 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:38.017328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:38.017968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:38.018237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:38.018501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:38.019726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:38.021213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74c52a-a2df-4ddb-9fe7-de56660ac5fc None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:38.022781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 561/1109] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:38.032773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:38.153875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4765ac-6a45-4c45-b96a-5b55a544ab8c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:38.189302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:38.189898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:38.190168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:38.190432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:38.191066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:38.192495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2061-3943-4eee-82a9-38463c5839eb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:38.216837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 549/1110] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:33:38 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:40.185231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b96a5-6872-4a4f-b083-095a3a7caed2 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:40.186082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b96a5-6872-4a4f-b083-095a3a7caed2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:40.186082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b96a5-6872-4a4f-b083-095a3a7caed2 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:40.188296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 562/1111] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:40.194577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:40.195271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:40.195415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:40.215668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:40.216862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:40.245921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:40.293505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 550/1112] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:40.559359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b96a5-6872-4a4f-b083-095a3a7caed2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:40.674650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b96a5-6872-4a4f-b083-095a3a7caed2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:40.699973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:40.709730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:40.710353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:40.710626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:40.710896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] PATH_INFO: `/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:40.712432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] RBAC: Authorizing `identity:get_role(role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:40.713826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:40.715167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 563/1113] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:40 2022] GET /identity/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:40.724432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:40.824954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49298421-e536-451f-b0f8-33a3a5e57162 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:40.863473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:40.864081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:40.864352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:40.864615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] PATH_INFO: `/v3/users/9958c92bee7f44aa85b903e6600fcae9` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:40.878175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=9958c92bee7f44aa85b903e6600fcae9)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:40.879604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:40.881190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 551/1114] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:40 2022] GET /identity/v3/users/9958c92bee7f44aa85b903e6600fcae9 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:40.887640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:41.005350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde72b71-5201-4ac0-b0c3-ea7a9fbe30f8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:41.041930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:41.042518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:41.042789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:41.043055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:41.107311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:41.115772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:41.117297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:41.226934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 564/1115] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:41.233185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:41.257608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:41.332985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a31e7-5847-4dce-9eeb-75dde54f4ea8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:41.365864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:41.366423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:41.366691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:41.366949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:41.368191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:41.369657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24f77-832e-450b-a5d2-06e8bcf80873 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:41.371320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 552/1116] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:41 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:41.377854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:41.478080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:41.487755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8f064-d2b2-4e28-8892-4c5d17ab5afe None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:41.531567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:41.532167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:41.532437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:41.532701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:41.533460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=70d8098e4ab745e99563d8804c15eb21, user.id=9958c92bee7f44aa85b903e6600fcae9) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:41.533758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:41.535235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c30a8-671d-4478-aa5d-00dec9430024 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:41.540818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 565/1117] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:41 2022] GET /identity/v3/role_assignments?user.id=9958c92bee7f44aa85b903e6600fcae9&scope.project.id=70d8098e4ab745e99563d8804c15eb21&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:43.429390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9302d-50c6-4b3f-8b0f-7735652397d4 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:43.430070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9302d-50c6-4b3f-8b0f-7735652397d4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:43.430070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9302d-50c6-4b3f-8b0f-7735652397d4 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:43.431329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 553/1118] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:43.437844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:43.438627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:43.438744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:43.464252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:43.465484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:43.544592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 566/1119] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:43.810640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9302d-50c6-4b3f-8b0f-7735652397d4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:43.913510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:43.927163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9302d-50c6-4b3f-8b0f-7735652397d4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:43.973396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:43.974017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:43.974286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:43.974552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] PATH_INFO: `/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:43.975978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] RBAC: Authorizing `identity:get_role(role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:43.977454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:43.978865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 554/1120] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:43 2022] GET /identity/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:43.987857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:44.080225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:44.097865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989436-a584-420b-acba-1a0904aabeb9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:44.135771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:44.136398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:44.136672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:44.136939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] PATH_INFO: `/v3/users/9958c92bee7f44aa85b903e6600fcae9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:44.138409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] RBAC: Authorizing `identity:get_user(user_id=9958c92bee7f44aa85b903e6600fcae9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:44.140054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:44.141705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 567/1121] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:43 2022] GET /identity/v3/users/9958c92bee7f44aa85b903e6600fcae9 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:44.151192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:44.257330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e55ad-7441-4ebb-8b14-5b56f0c53784 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:44.294074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:44.294716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:44.295099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:44.295365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:44.296592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:44.298058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421700b5-0b53-4336-aa6f-d7cb18f3ae0d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:44.299698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 555/1122] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:44 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:44.308315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:44.418619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc5ad7-c639-4352-9131-f119cf4b2d26 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:44.460419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:44.461066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:44.461356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:44.461620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21/users/9958c92bee7f44aa85b903e6600fcae9/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:44.463749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] RBAC: Authorizing `identity:create_grant(project_id=70d8098e4ab745e99563d8804c15eb21, user_id=9958c92bee7f44aa85b903e6600fcae9, role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:44.465232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b759b-c95d-4a8c-853c-b4da4770c768 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:44.481450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 568/1123] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:33:44 2022] PUT /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21/users/9958c92bee7f44aa85b903e6600fcae9/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:33:46.342360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0eba-041b-43dd-a347-33d9c3e8675f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:46.343001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0eba-041b-43dd-a347-33d9c3e8675f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:46.343001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0eba-041b-43dd-a347-33d9c3e8675f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:46.344205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 556/1124] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:46.350911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:46.351627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:46.351798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:46.377549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:46.378744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:46.389834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:46.449141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 569/1125] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:46.715743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0eba-041b-43dd-a347-33d9c3e8675f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:46.752969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:46.840928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0eba-041b-43dd-a347-33d9c3e8675f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:46.877290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:46.877962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:46.878233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:46.878500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] PATH_INFO: `/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:46.880038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] RBAC: Authorizing `identity:get_role(role_id=ed7ee95ed89a4bb68b6dad26d85bca03)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:46.881515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:46.882950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 557/1126] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:46 2022] GET /identity/v3/roles/ed7ee95ed89a4bb68b6dad26d85bca03 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:46.889338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:46.999272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb32b-11d4-4873-a63d-e760708fc8b9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:47.034524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:47.035140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:47.035408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:47.035687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] PATH_INFO: `/v3/users/9958c92bee7f44aa85b903e6600fcae9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:47.036954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] RBAC: Authorizing `identity:get_user(user_id=9958c92bee7f44aa85b903e6600fcae9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:47.038505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:47.040243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 570/1127] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:46 2022] GET /identity/v3/users/9958c92bee7f44aa85b903e6600fcae9 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:47.046746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:47.150525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:47.157713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec7018-581e-4d74-9ca3-fa641ef3438e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:47.194072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:47.194707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:47.194989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:47.195261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:47.275064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:47.276454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:47.372366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:47.380882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 558/1128] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:47.388541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:47.406001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:47.498638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef304b-0dd5-43d6-8088-03a010e14483 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:47.536352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:47.536936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:47.537224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:47.537490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] PATH_INFO: `/v3/projects/70d8098e4ab745e99563d8804c15eb21` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:47.538748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] RBAC: Authorizing `identity:get_project(project_id=70d8098e4ab745e99563d8804c15eb21)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:47.540311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2134f-eada-496f-9a6a-148116a39d23 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:47.542007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 571/1129] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:47 2022] GET /identity/v3/projects/70d8098e4ab745e99563d8804c15eb21 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:47.548467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:47.655489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c1d7b-d69e-45ce-8318-a98f0f8c0f86 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:47.691637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:47.692228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:47.692499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:47.692770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:47.693517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] RBAC: Adding query filter params (role.id=ed7ee95ed89a4bb68b6dad26d85bca03, scope.project.id=70d8098e4ab745e99563d8804c15eb21, user.id=9958c92bee7f44aa85b903e6600fcae9) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:47.693816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:47.695255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36153c1-da56-471b-b5d2-34db823214d3 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:47.701246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 559/1130] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:47 2022] GET /identity/v3/role_assignments?user.id=9958c92bee7f44aa85b903e6600fcae9&scope.project.id=70d8098e4ab745e99563d8804c15eb21&role.id=ed7ee95ed89a4bb68b6dad26d85bca03 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:49.588165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aee69-df3b-412c-b970-55c42a4eca87 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:49.589144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aee69-df3b-412c-b970-55c42a4eca87 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:49.589144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aee69-df3b-412c-b970-55c42a4eca87 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:49.591064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 572/1131] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:49.599969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:49.600390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:49.600559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:49.620237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:49.621457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:49.678950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:49.695714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 560/1132] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:49.966092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aee69-df3b-412c-b970-55c42a4eca87 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:50.057472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:50.078008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aee69-df3b-412c-b970-55c42a4eca87 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:50.113574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:50.114191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:50.114460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:50.114723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:50.115977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:50.117459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d130f-8cb4-4358-9408-bf006825b937 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:50.119141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 573/1133] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:50.126124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:50.241548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa573c-e162-4a62-a443-cdb68a4ca678 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:50.276354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:50.276966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:50.277271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:50.277529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:50.278174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:50.279609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b434e36-9f26-41d2-8551-ce62fc9c0627 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:50.316649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 561/1134] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:33:50 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:52.232129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46a5e-2ed5-4819-a09e-c97cf721f2d2 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:52.232600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46a5e-2ed5-4819-a09e-c97cf721f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:52.232697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46a5e-2ed5-4819-a09e-c97cf721f2d2 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:52.234095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 574/1135] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:52.239436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:52.239875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:52.240077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:52.259090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:52.260328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:52.296687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:52.334185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 562/1136] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:52.599910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e46a5e-2ed5-4819-a09e-c97cf721f2d2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:52.723096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e46a5e-2ed5-4819-a09e-c97cf721f2d2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:52.759777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:52.760400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:52.760667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:52.760947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:52.762123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:52.763561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf72712-a6d1-484c-835d-d89267cbac0c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:52.765152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 575/1137] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:33:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:52.771713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:52.888717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940189d2-539f-46bc-98fb-a09d2d415f77 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:52.927258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:52.927854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:52.928130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:52.928397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:52.929071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:52.930501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d100e35-e6bd-47ac-9b4e-011f71d33404 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:52.954398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 563/1138] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:33:52 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:33:54.870526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c36b7-bc32-4496-804f-f02df9787a97 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:54.871125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c36b7-bc32-4496-804f-f02df9787a97 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:54.871125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c36b7-bc32-4496-804f-f02df9787a97 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:54.872430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 576/1139] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:54.878946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:54.879673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:54.879822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:54.901745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:54.902922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:54.925725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:54.982306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 564/1140] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:55.247383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c36b7-bc32-4496-804f-f02df9787a97 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:55.278363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:55.369695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c36b7-bc32-4496-804f-f02df9787a97 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:55.405944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:55.406610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:55.406886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:55.407152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:55.418192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:55.422940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:55.424172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:55.425469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:55.429099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 577/1141] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:55.430847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:55.539676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da4fc3-1598-4f64-9883-a0caaeb0caaf None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:55.575084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:55.575683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:55.575955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:55.576222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:55.576883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:55.577223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:55.578608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:55.586666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 565/1142] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:55.592960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:55.684590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:55.709190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0d1e-00da-4dcf-9b63-6bc07434f327 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:55.745155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:55.745786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:55.746057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:55.746329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] PATH_INFO: `/v3/users/bb4e36560227413589a91126badad7a5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:55.759978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb4e36560227413589a91126badad7a5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:55.761484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:55.763087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 578/1143] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:55 2022] GET /identity/v3/users/bb4e36560227413589a91126badad7a5 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:55.769529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:55.792306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:55.874086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccdf5d-c17a-4c81-80e1-0cf94eb75195 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:55.909165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:55.909782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:55.910021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:55.910292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:55.980822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:55.982306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:56.000721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:56.084087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 566/1144] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:33:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:56.090271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:56.193963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112535a-9d94-4524-ae4c-e4d725f024a3 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:56.231941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:56.232668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:56.232964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:56.233233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] PATH_INFO: `/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:56.234401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] RBAC: Authorizing `identity:get_project(project_id=d3aa938b39134d9c9ef7e7f13b8988ce)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:56.235833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b059-0c05-4008-8f71-5a14a8b93066 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:56.237493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 579/1145] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:56 2022] GET /identity/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:56.243816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:56.360070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239697e-3bf9-4de9-84d6-95083bf332c2 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:56.378742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:56.396658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:56.397295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:56.397570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:56.397840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:56.398884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=d3aa938b39134d9c9ef7e7f13b8988ce, user.id=bb4e36560227413589a91126badad7a5) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:56.399190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:56.400622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2006b6-31aa-4775-8a84-6b3887db1849 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:56.406039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 567/1146] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:33:56 2022] GET /identity/v3/role_assignments?user.id=bb4e36560227413589a91126badad7a5&scope.project.id=d3aa938b39134d9c9ef7e7f13b8988ce&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:58.242666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0f91-7396-4d1e-bf40-c10545cc0de1 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:58.243232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0f91-7396-4d1e-bf40-c10545cc0de1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:58.243232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0f91-7396-4d1e-bf40-c10545cc0de1 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:58.244658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 580/1147] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:33:58.251240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:58.251655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:58.251802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:58.279730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:33:58.280950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:33:58.366872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 568/1148] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:33:58.635041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b0f91-7396-4d1e-bf40-c10545cc0de1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:58.640395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:58.751705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b0f91-7396-4d1e-bf40-c10545cc0de1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:58.787733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:58.788348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:58.788624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:58.788880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:58.799038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:33:58.803680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:33:58.804696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:33:58.806702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 581/1149] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:33:58.811072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:58.910518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0b3a6-0ef9-47f9-879b-e7c648e5489e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:58.923741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:58.945674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:58.946337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:58.946607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:58.946870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:58.947520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:33:58.947813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:58.949209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:58.957171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 569/1150] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:58.963627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:59.041147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:59.079505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afef7a2-c304-4133-aee0-07457337e4fd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:59.114488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:59.115102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:59.115377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:59.115650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] PATH_INFO: `/v3/users/bb4e36560227413589a91126badad7a5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:59.116948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] RBAC: Authorizing `identity:get_user(user_id=bb4e36560227413589a91126badad7a5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:59.118442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:59.120066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 582/1151] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:33:58 2022] GET /identity/v3/users/bb4e36560227413589a91126badad7a5 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:59.126289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:59.232575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6293b8-d432-46fd-83c6-525f1fb8bcad None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:59.266826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:59.267396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:59.267703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:59.267962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] PATH_INFO: `/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:59.269226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] RBAC: Authorizing `identity:get_project(project_id=d3aa938b39134d9c9ef7e7f13b8988ce)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:59.270661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b88cc-990f-474f-ab6c-f3dc17694c88 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:59.272289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 570/1152] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:33:59 2022] GET /identity/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:33:59.279173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:33:59.383326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4c79b-e13f-4315-bff1-79f2003fb62d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:33:59.414230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:59.420770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:33:59.421459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:33:59.421737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:33:59.422011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] PATH_INFO: `/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce/users/bb4e36560227413589a91126badad7a5/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:33:59.424039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3aa938b39134d9c9ef7e7f13b8988ce, user_id=bb4e36560227413589a91126badad7a5, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:33:59.425624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa872b-0609-4e99-a016-a04b41813699 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:33:59.441670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 583/1153] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:33:59 2022] PUT /identity/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce/users/bb4e36560227413589a91126badad7a5/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:34:01.301020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f83e-ed23-4d75-91e0-5f5c3741e6f4 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:01.301564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f83e-ed23-4d75-91e0-5f5c3741e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:01.301564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5f83e-ed23-4d75-91e0-5f5c3741e6f4 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:01.302980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 571/1154] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:01.309373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:01.310061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:01.310203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:01.338851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:01.340038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:01.410996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 584/1155] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:01.672189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f83e-ed23-4d75-91e0-5f5c3741e6f4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:01.726925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:01.788636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5f83e-ed23-4d75-91e0-5f5c3741e6f4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:01.823570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:01.824184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:01.824455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:01.824722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:01.835996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:34:01.841570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:34:01.842663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:34:01.843855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 572/1156] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:34:01.850823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:01.956557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af1e6e-cce9-4f10-84bc-484bf5ad11cb None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:01.979745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:01.995707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:01.996329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:01.996599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:01.996867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:01.997598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:01.997955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:01.999343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:02.007440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 585/1157] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:02.013497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:02.118002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248758-160b-4295-8f9f-1a5dac5a8455 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:02.119566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:02.154320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:02.154936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:02.155214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:02.155485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] PATH_INFO: `/v3/users/bb4e36560227413589a91126badad7a5` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:02.156658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] RBAC: Authorizing `identity:get_user(user_id=bb4e36560227413589a91126badad7a5)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:02.158130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:02.159692 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 573/1158] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:34:02 2022] GET /identity/v3/users/bb4e36560227413589a91126badad7a5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:02.169694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:02.291379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc92ff-2116-4a47-bcf4-d85fd86a2b27 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:02.328286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:02.328881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:02.329191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:02.329459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:02.379445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:02.407107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:02.409335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:02.520209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 586/1159] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:34:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:34:02.526967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:02.632450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e330d8-4d6a-4993-b9a0-e21412464feb None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:02.667726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:02.668333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:02.668606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:02.668891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] PATH_INFO: `/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:02.670153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] RBAC: Authorizing `identity:get_project(project_id=d3aa938b39134d9c9ef7e7f13b8988ce)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:02.671583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe90f70-5dc9-4622-ad51-76a4a49dee0d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:02.673207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 574/1160] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:34:02 2022] GET /identity/v3/projects/d3aa938b39134d9c9ef7e7f13b8988ce => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:02.680171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:02.769792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:02.785978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f8e6-56a1-4dda-a2a1-ccdc3ed5b36c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:02.823339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:02.823934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:02.824205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:02.824474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:02.825228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=d3aa938b39134d9c9ef7e7f13b8988ce, user.id=bb4e36560227413589a91126badad7a5) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:02.825533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:02.827003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ef89-6960-4cbb-8e52-7fcb8db96ef3 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:02.833347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 587/1161] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:34:02 2022] GET /identity/v3/role_assignments?user.id=bb4e36560227413589a91126badad7a5&scope.project.id=d3aa938b39134d9c9ef7e7f13b8988ce&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:04.727634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632419-8e55-42de-ba59-3532b77f9a0e None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:04.728488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632419-8e55-42de-ba59-3532b77f9a0e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:04.728488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632419-8e55-42de-ba59-3532b77f9a0e None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:04.730638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 575/1162] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:04.738821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:04.739306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:04.739306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:04.759196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:04.760363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:04.829771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 588/1163] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:05.098943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632419-8e55-42de-ba59-3532b77f9a0e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:05.145248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:05.209380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632419-8e55-42de-ba59-3532b77f9a0e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:05.245232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:05.245904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:05.246175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:05.246448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:05.326193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:05.327690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:05.365954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:05.429571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 576/1164] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:34:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:34:05.438978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:05.533032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:05.556989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0cf63-6558-445e-8da5-aff3b00f99a5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:05.603548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:05.604189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:05.604493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:05.604759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:05.611966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:05.613520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-1bb83620-3199-4a27-a1e2-75f9154d0452 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:34:05.625108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:34:05.626165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:34:05.627134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 589/1165] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:34:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:34:05.632559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:05.765437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fe76-6b25-4817-a068-59fed2123514 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:05.808085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:05.808685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:05.808993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:05.809263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:05.809906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:05.810180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:05.811574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a7ae4-02a2-452b-b987-095e37f48cdb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:05.826009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 577/1166] 10.222.0.93 () {56 vars in 1115 bytes} [Wed Aug 24 15:34:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:07.717547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b74-a3e6-47ca-b90a-a691bf4ea3cd None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:07.718411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b74-a3e6-47ca-b90a-a691bf4ea3cd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:07.718411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b74-a3e6-47ca-b90a-a691bf4ea3cd None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:07.720619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 590/1167] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:07.726156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10439-20a5-44b9-a0a4-7af529d2e5e2 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:07.726579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10439-20a5-44b9-a0a4-7af529d2e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:07.726670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a10439-20a5-44b9-a0a4-7af529d2e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:07.733615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:07.748959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-55a10439-20a5-44b9-a0a4-7af529d2e5e2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:07.750181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-55a10439-20a5-44b9-a0a4-7af529d2e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:07.821140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 578/1168] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:08.091802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21b74-a3e6-47ca-b90a-a691bf4ea3cd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:08.212128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21b74-a3e6-47ca-b90a-a691bf4ea3cd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:08.247487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:08.248105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:08.248378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:08.248649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:08.249338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:08.250726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c7fed-61e6-43cf-a45b-6b87e001c87c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:08.263771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:08.271572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 591/1169] 10.222.0.93 () {60 vars in 1138 bytes} [Wed Aug 24 15:34:08 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:34:10.158375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1527d-f169-42ca-bfd6-2bad0097656f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:10.158966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1527d-f169-42ca-bfd6-2bad0097656f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:10.158966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1527d-f169-42ca-bfd6-2bad0097656f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:10.160256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 579/1170] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:10.166768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:10.167479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:10.167640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:10.196423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:10.197638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:10.265822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 592/1171] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:10.528853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1527d-f169-42ca-bfd6-2bad0097656f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:10.645117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1527d-f169-42ca-bfd6-2bad0097656f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:10.676158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:10.684818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:10.685803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:10.686183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:10.686547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] PATH_INFO: `/v3/domains/4e05c55ff673499988953791bbfb6469` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:10.702161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e05c55ff673499988953791bbfb6469)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:10.703622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bda07-20fa-4038-b8a2-d0009b4b1b43 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:10.705246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 580/1172] 10.222.0.93 () {56 vars in 1183 bytes} [Wed Aug 24 15:34:10 2022] GET /identity/v3/domains/4e05c55ff673499988953791bbfb6469 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:10.711331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:10.812397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4488e-2fca-44b0-bcc4-c978227a422c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:10.839020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:10.848599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:10.849226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:10.849498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:10.849790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:10.850409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:10.851861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc613a-4728-4972-8ebe-1472d9d33ba4 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:10.886867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 593/1173] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:34:10 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:34:12.786049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fca2-2669-4d63-8019-a629bdc4e58e None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:12.786981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fca2-2669-4d63-8019-a629bdc4e58e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:12.786981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fca2-2669-4d63-8019-a629bdc4e58e None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:12.789083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 581/1174] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:12.795396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:12.795827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:12.795939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:12.818948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:12.820221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:12.890911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 594/1175] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:13.158381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fca2-2669-4d63-8019-a629bdc4e58e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:13.281628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fca2-2669-4d63-8019-a629bdc4e58e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:13.317455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:13.318078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:13.318350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:13.318617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] PATH_INFO: `/v3/domains/4e05c55ff673499988953791bbfb6469` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:13.319840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e05c55ff673499988953791bbfb6469)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:13.321307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6209-61b9-4448-b576-a394345b2eeb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:13.322854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 582/1176] 10.222.0.93 () {56 vars in 1183 bytes} [Wed Aug 24 15:34:13 2022] GET /identity/v3/domains/4e05c55ff673499988953791bbfb6469 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:13.332431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:13.440317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7ffe2-00b9-4ab9-9ec6-da5aebdc749d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:13.451195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:13.483905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:13.484512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:13.484785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:13.485089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:13.485732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:13.487175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156d045-9071-49d5-a538-29aa74e13f0b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:13.510137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 595/1177] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:34:13 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:34:15.449524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880c8a-054e-4a69-9dd2-4fcb7945f98d None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:15.450460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880c8a-054e-4a69-9dd2-4fcb7945f98d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:15.450460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b880c8a-054e-4a69-9dd2-4fcb7945f98d None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:15.452694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 583/1178] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:15.458291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:15.458758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:15.458868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:15.479081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:15.480239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:15.554126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 596/1179] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:15.830957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b880c8a-054e-4a69-9dd2-4fcb7945f98d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:15.914422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:15.967533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b880c8a-054e-4a69-9dd2-4fcb7945f98d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:16.003193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:16.003811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:16.004084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:16.004347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:16.015861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:34:16.020509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:34:16.021742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:34:16.022847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 584/1180] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:34:16.028469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:16.121451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:16.130366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987b373-dae1-4681-92e2-ac5f609a565e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:16.181234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:16.182275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:16.182722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:16.183199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:16.184389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:16.184945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:16.187370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:16.197736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 597/1181] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:16.207556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:16.331014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434d46-6c6e-411b-ad96-f1532f530466 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:16.359742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:16.385416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:16.386345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:16.386802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:16.387248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] PATH_INFO: `/v3/users/73fd8af1c04d4accadef14dc3daa6980` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:16.404466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] RBAC: Authorizing `identity:get_user(user_id=73fd8af1c04d4accadef14dc3daa6980)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:16.405951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:16.407573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 585/1182] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:34:16 2022] GET /identity/v3/users/73fd8af1c04d4accadef14dc3daa6980 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:16.416369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:16.521838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c185b-061c-4996-bee1-03c7825c5b4c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:16.562357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:16.563219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:16.563626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:16.564028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:16.601248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:16.657942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:16.659784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:16.776712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 598/1183] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:34:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:34:16.783653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:16.903292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048bd80-7088-4609-8006-fec595446d26 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:16.944061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:16.944615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:16.944887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:16.945187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] PATH_INFO: `/v3/projects/08398d045bb14c7c890d2bfbc1253937` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:16.946383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=08398d045bb14c7c890d2bfbc1253937)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:16.947821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88aeef-aacd-4ce1-a804-6cc99211cdc6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:16.949485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 586/1184] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:34:16 2022] GET /identity/v3/projects/08398d045bb14c7c890d2bfbc1253937 => generated 361 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:16.955877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:17.023487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:17.075397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094bf64-50e6-4b8f-93e1-4fcdf187aeae None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:17.119615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:17.120212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:17.120483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:17.120747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:17.121502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=08398d045bb14c7c890d2bfbc1253937, user.id=73fd8af1c04d4accadef14dc3daa6980) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:17.121804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:17.123335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058557a4-2507-4d7c-b747-a984d818c5f8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:17.128788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 599/1185] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:34:16 2022] GET /identity/v3/role_assignments?user.id=73fd8af1c04d4accadef14dc3daa6980&scope.project.id=08398d045bb14c7c890d2bfbc1253937&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:19.191307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621eb-7d85-4199-b0d1-6f1a47b7cb9f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:19.192208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621eb-7d85-4199-b0d1-6f1a47b7cb9f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:19.192208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8621eb-7d85-4199-b0d1-6f1a47b7cb9f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:19.194352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 587/1186] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:19.199776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:19.200212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:19.200332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:19.222850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:19.224034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:19.299151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 600/1187] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:19.593922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8621eb-7d85-4199-b0d1-6f1a47b7cb9f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:19.651038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:19.707915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8621eb-7d85-4199-b0d1-6f1a47b7cb9f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:19.743258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:19.743883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:19.744159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:19.744421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:19.755382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:34:19.760107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:34:19.761198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:34:19.762201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 588/1188] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:34:19.770005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:19.830947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:19.887580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb783ff7-e244-434e-96ea-296b90a0c06b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:19.923975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:19.924581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:19.924858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:19.925159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:19.925824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:19.926120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:19.927518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:19.935695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 601/1189] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:19.941917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:20.052752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7762-d7c4-4706-b254-ab3a63c7b57f None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:20.065480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:20.095625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:20.096343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:20.096620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:20.096893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] PATH_INFO: `/v3/users/73fd8af1c04d4accadef14dc3daa6980` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:20.098231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] RBAC: Authorizing `identity:get_user(user_id=73fd8af1c04d4accadef14dc3daa6980)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:20.099691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:20.101322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 589/1190] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:34:19 2022] GET /identity/v3/users/73fd8af1c04d4accadef14dc3daa6980 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:20.110839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:20.216422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668570-3f67-4a55-8a05-eeadfccdb81f None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:20.230904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:20.256700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:20.257434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:20.257747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:20.258056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] PATH_INFO: `/v3/projects/08398d045bb14c7c890d2bfbc1253937` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:20.259256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] RBAC: Authorizing `identity:get_project(project_id=08398d045bb14c7c890d2bfbc1253937)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:20.260765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df7e9f-bbbd-4456-8b5c-6b4da15138b7 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:20.263289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 602/1191] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:34:20 2022] GET /identity/v3/projects/08398d045bb14c7c890d2bfbc1253937 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:20.272300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:20.383558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb5641-4c06-4e31-a162-3c014278e211 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:20.420427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:20.421119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:20.421391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:20.421658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] PATH_INFO: `/v3/projects/08398d045bb14c7c890d2bfbc1253937/users/73fd8af1c04d4accadef14dc3daa6980/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:20.423641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=08398d045bb14c7c890d2bfbc1253937, user_id=73fd8af1c04d4accadef14dc3daa6980, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:20.425127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc30710-0d72-49ee-af00-41e0bc42a1a9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:20.446392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 590/1192] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:34:20 2022] PUT /identity/v3/projects/08398d045bb14c7c890d2bfbc1253937/users/73fd8af1c04d4accadef14dc3daa6980/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:34:22.299679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8874-c16e-4c07-b6ec-93c8e74fc897 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:22.300241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8874-c16e-4c07-b6ec-93c8e74fc897 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:22.300241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd8874-c16e-4c07-b6ec-93c8e74fc897 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:22.301616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 603/1193] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:34:22.308125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:22.308882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:22.309065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:22.339128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:34:22.340309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:34:22.367598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:22.410983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 591/1194] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:34:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:22.675960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd8874-c16e-4c07-b6ec-93c8e74fc897 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:22.787020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd8874-c16e-4c07-b6ec-93c8e74fc897 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:22.824791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:22.825467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:22.825770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:22.826019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:22.837387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:34:22.842204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:34:22.843296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:34:22.844281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 604/1195] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:34:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:34:22.849680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:22.962154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6807f-f335-480a-b962-63fa7d1f7d4c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:23.005522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:23.006438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:23.006868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:23.007290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:23.008326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:23.008631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:23.010591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:23.024063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 592/1196] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:34:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:34:23.030280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:23.078717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:23.136559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210c8f-2b0f-48a5-8a2a-a7ca6aa0be9e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:23.174767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:23.175398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:23.175670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:23.175942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] PATH_INFO: `/v3/users/73fd8af1c04d4accadef14dc3daa6980` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:23.177203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] RBAC: Authorizing `identity:get_user(user_id=73fd8af1c04d4accadef14dc3daa6980)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:23.178649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:23.180281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 605/1197] 10.222.0.93 () {56 vars in 1177 bytes} [Wed Aug 24 15:34:23 2022] GET /identity/v3/users/73fd8af1c04d4accadef14dc3daa6980 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:23.186375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:23.217611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:23.304943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34b20-e11c-4a1b-a8e3-4e86b2c82b9b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:23.340854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:23.341548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:23.341806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:23.342069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:23.418010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:23.419477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:23.447025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:23.526749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 593/1198] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:34:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:34:23.533299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:23.649574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445ef3a-2b31-46d3-af87-2e4a930d6b31 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:23.661699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:23.690781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:23.691378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:23.691672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:23.691930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] PATH_INFO: `/v3/projects/08398d045bb14c7c890d2bfbc1253937` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:23.693170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] RBAC: Authorizing `identity:get_project(project_id=08398d045bb14c7c890d2bfbc1253937)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:23.694604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196c185-1e7e-4b1e-99cb-8aa95ed06483 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:23.696371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 606/1199] 10.222.0.93 () {56 vars in 1186 bytes} [Wed Aug 24 15:34:23 2022] GET /identity/v3/projects/08398d045bb14c7c890d2bfbc1253937 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:23.703568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:34:23.813314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4920-bad1-40f6-9e12-352a37b75590 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:34:23.838822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:23.848224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:34:23.848820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:34:23.849122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:34:23.849388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:34:23.850099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=08398d045bb14c7c890d2bfbc1253937, user.id=73fd8af1c04d4accadef14dc3daa6980) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:34:23.850401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:34:23.851842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e9620-bf10-441f-b193-b0c0c27ef50c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:34:23.857540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 594/1200] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:34:23 2022] GET /identity/v3/role_assignments?user.id=73fd8af1c04d4accadef14dc3daa6980&scope.project.id=08398d045bb14c7c890d2bfbc1253937&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:34:33.685343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=11 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:33.855038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:19.040493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fcfd8-3032-44bd-a2b8-50cb0d3b9906 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:19.041148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fcfd8-3032-44bd-a2b8-50cb0d3b9906 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:19.041148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fcfd8-3032-44bd-a2b8-50cb0d3b9906 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:19.042464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 607/1201] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:19.049536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:19.050056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:19.050056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:19.071270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:19.072630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:19.156934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 595/1202] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:19.459760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fcfd8-3032-44bd-a2b8-50cb0d3b9906 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:19.612034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fcfd8-3032-44bd-a2b8-50cb0d3b9906 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:19.652340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:19.653132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:19.653544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:19.653822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:19.664773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:19.669876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:19.687998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:19.689134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:19.690161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:19.690161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:19.690161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:19.693248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 608/1203] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:19.695400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:19.819952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534bc1c-5176-44f5-8d28-4b3369ebc998 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:19.853353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:19.860309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:19.861050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:19.861358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:19.861686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:19.862467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:19.862833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:19.864396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70af58d-be04-4f94-be3e-4b4d2488b7a5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:19.880981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 596/1204] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:19.884433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:19.951052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:20.011191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263ab9-002d-4d44-b2b0-66cc204f6e80 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:20.055801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:20.056544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:20.056716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:20.057026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:20.057835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:20.059838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad651-bf1b-4939-8965-41b1a6a3bfcb None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:20.088715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 609/1205] 10.222.0.93 () {60 vars in 1132 bytes} [Wed Aug 24 15:35:19 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:35:22.215531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af91c98-595a-4056-8f0a-281a651e48c9 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:22.216143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af91c98-595a-4056-8f0a-281a651e48c9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:22.216143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af91c98-595a-4056-8f0a-281a651e48c9 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:22.217525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 597/1206] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:22.224370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:22.224856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:22.224986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:22.244713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:22.246485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:22.330490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 610/1207] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:22.645871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af91c98-595a-4056-8f0a-281a651e48c9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:22.768051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af91c98-595a-4056-8f0a-281a651e48c9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:22.806605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:22.807256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:22.807566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:22.807865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:22.823102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:22.828071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:22.829202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:22.830421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 598/1208] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:22.836157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:22.881631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:22.958205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef0a6-8d17-4d95-ba63-5ee9faac8775 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.002444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.003396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.003759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.003934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:23.004747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:23.005052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:23.006540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:23.016236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 611/1209] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:23.023264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:23.092736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:23.153843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7602708-242c-4b0f-8216-3ccea844d91b None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.197731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.198515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.198814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.199082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:23.211152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:23.212515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:23.235211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:23.243391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:23.244627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:23.244627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:23.244627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:23.244627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 599/1210] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:23.245039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:23.362316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:23.366171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f9dc-6fa0-48f4-9aae-cf8efb96e9f8 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.407489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.408126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.408419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.408691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:23.409969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:23.409969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:23.411175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:23.430279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 612/1211] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:23.433560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:23.550741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf42c4-b837-4d99-88a9-51a80e7aa03c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.552620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:23.587824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.588654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.589120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.589462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:23.599247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:23.600047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:23.612011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:23.613577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:23.614868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 600/1212] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:23.619316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:23.730049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c51ff-5103-4444-b7f0-93c9d86c7453 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.770643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45889448-4620-4ec7-b889-54d772741677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.771256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889448-4620-4ec7-b889-54d772741677 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.771531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889448-4620-4ec7-b889-54d772741677 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.771798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889448-4620-4ec7-b889-54d772741677 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:23.772563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45889448-4620-4ec7-b889-54d772741677 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:23.772831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45889448-4620-4ec7-b889-54d772741677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:23.774593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45889448-4620-4ec7-b889-54d772741677 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:23.800167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 613/1213] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:23.801136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:23.923510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23776686-ccf3-4f74-86f1-f57b106349a9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:23.964431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:23.965459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:23.965806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:23.966108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:24.004485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:24.055306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:24.056781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:24.169626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 601/1214] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:35:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:24.175617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45889448-4620-4ec7-b889-54d772741677 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:24.200328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:24.308877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45889448-4620-4ec7-b889-54d772741677 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:24.349744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:24.350392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:24.350664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:24.350930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:24.361815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:24.363308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:24.383335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:24.384348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:24.385335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:24.385335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:24.385335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:24.385335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 614/1215] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:24.390774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:24.458489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:24.499299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fc8f8-f480-4838-b149-9e0623d5b396 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:24.535146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:24.535795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:24.536069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:24.536333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:24.536990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:24.537416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:24.538919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:24.556942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 602/1216] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:35:24.558294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:24.636504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:24.675291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7f-1760-4a69-9db2-8038d48de30b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:24.712377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:24.713069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:24.713344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:24.713610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:24.720711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:24.722176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:24.734004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:24.735179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:24.736311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:24.738532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 615/1217] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:24.744806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:24.856517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c209e87-2231-418b-b837-e7105c2c7635 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:24.881326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:24.896086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:24.896620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:24.896926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:24.897210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:24.897881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:24.898184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:24.899941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbebe2b-5c13-4316-94e0-7f64e5cfd62c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:24.916131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 603/1218] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:24.919482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:25.030681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb707c9-8418-4139-ab91-0601bd4d22b6 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:25.061519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:25.068790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:25.069500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:25.069913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:25.070132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:25.070822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=176b283110c240159bbc525fd6745f1a) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:25.071064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:25.072508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162727-301b-4a91-b8c4-4cca63e7a79b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:25.078882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 616/1219] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:35:24 2022] GET /identity/v3/role_assignments?user.id=176b283110c240159bbc525fd6745f1a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:27.158853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc2b-94ef-4e5b-b1a2-96acfd158c62 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:27.159493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc2b-94ef-4e5b-b1a2-96acfd158c62 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:27.159493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc2b-94ef-4e5b-b1a2-96acfd158c62 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:27.160770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 604/1220] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:27.168521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:27.169108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:27.169550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:27.195964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:27.197330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:27.278721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 617/1221] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:27.567087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223dc2b-94ef-4e5b-b1a2-96acfd158c62 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:27.678214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223dc2b-94ef-4e5b-b1a2-96acfd158c62 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:27.716582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:27.717251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:27.717527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:27.717794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:27.728106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:27.732810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:27.733841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:27.734703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 605/1222] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:35:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:27.739980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:27.846970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb73267-ded1-4900-82d4-92283bf2863a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:27.874579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:27.886170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:27.886789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:27.887062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:27.887330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:27.888025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] RBAC: Adding query filter params (name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:27.888324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:27.889735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:27.898019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 618/1223] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:27.904376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:27.952018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:28.011038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5b9ab-3981-4fd3-a392-bb68c16520b8 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.049127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.049760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.050031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.050295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.063427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.065040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:28.080962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:28.082209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:28.083303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:28.083303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:28.083303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:28.083303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 606/1224] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:28.088748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:28.201441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09497aa-90bf-41ae-b808-1dab876c148c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.244824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.245516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.245821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.246085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.246732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:28.247107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.248460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.261700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 619/1225] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:28.269485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:28.386065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:28.393870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e443-273d-4da9-8bd6-12ff5a60d03c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.428553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.429215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.429491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.429761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.438026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.439637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:28.451951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:28.453178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:28.454731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 607/1226] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:35:28.459395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:28.509891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:28.571181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db650798-5f4e-49d9-816c-758010984c5e None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.609416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.610041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.610316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.610582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.611314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:28.611631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.613154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.633738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 620/1227] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:28.640229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:28.760059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618dbff-6a59-4a6d-ac86-40bf73e5ded5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.799378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.800013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.800284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.800548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.811731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.813492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:28.828500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:28.829841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:28.831396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:28.831396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:28.831396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:28.831396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 608/1228] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:28.836263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:28.944225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935724f-e75b-4cf6-9eaa-e2ee10d09fb1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:28.947157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:28.982011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:28.982679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:28.982969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:28.983260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:28.983956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:28.984269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:28.985907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:28.998099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 621/1229] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:29.004848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:29.014957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:29.112077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6923-1981-4179-8b1f-be6a41cce629 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:29.147708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:29.148394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:29.149029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:29.149349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:29.156701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:29.158190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:29.169795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:29.171001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:29.172168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 609/1230] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:29.177827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:29.293602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd280ea-92c2-40ed-8b29-292d2e6f4565 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:29.329650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:29.330281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:29.330644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:29.330914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:29.331730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:29.332032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:29.333612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d69c3-3921-4505-b127-9b2a14d4014b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:29.346214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 622/1231] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:35:29.352171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:29.422902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:29.460096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258c2f-0ffe-48ac-95f1-9acd4a4690eb None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:29.501643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:29.502402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:29.502742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:29.503037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/176b283110c240159bbc525fd6745f1a/roles/15ff0792d3924f59b623e13bd83d2de5` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:29.518557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=176b283110c240159bbc525fd6745f1a, role_id=15ff0792d3924f59b623e13bd83d2de5)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:29.520040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0d825-0424-44d8-ae5d-eb48a723df28 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:29.534440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 610/1232] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:35:29 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/176b283110c240159bbc525fd6745f1a/roles/15ff0792d3924f59b623e13bd83d2de5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:35:31.567015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308231b1-eec4-4737-969c-8310f4c56ca7 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:31.567573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308231b1-eec4-4737-969c-8310f4c56ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:31.567573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308231b1-eec4-4737-969c-8310f4c56ca7 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:31.569161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 623/1233] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:31.574979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:31.575467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:31.575592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:31.594714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:31.595945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:31.668210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 611/1234] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:31.952277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308231b1-eec4-4737-969c-8310f4c56ca7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:31.979471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:32.059876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308231b1-eec4-4737-969c-8310f4c56ca7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:32.098092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:32.098727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:32.098982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:32.099248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:32.111486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:32.116370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:32.117575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:32.118441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 624/1235] 10.222.0.93 () {56 vars in 1102 bytes} [Wed Aug 24 15:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:32.123930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:32.179857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:32.248119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108799-9710-45b8-b9ff-ee38ddbff223 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:32.292264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:32.292913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:32.293244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:32.293517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:32.294500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] RBAC: Adding query filter params (name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:32.294751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:32.296199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:32.304800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 612/1236] 10.222.0.93 () {56 vars in 1103 bytes} [Wed Aug 24 15:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:32.311214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:32.406014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:32.423522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14fe34-15a7-419a-b6a0-5f78c2235326 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:32.459404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:32.460065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:32.460325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:32.460587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:32.473161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:32.474780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:32.490513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:32.491508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:32.492423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:32.492423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:32.492423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:32.492423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 625/1237] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:32.498418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:32.609299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7145f9-c884-4ac3-9ea7-921a6d396586 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:32.619398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:32.647990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:32.649002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:32.649221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:32.649486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:32.650161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:32.650432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:32.651812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:32.663999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 613/1238] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:32.670273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:32.781551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dff11-329e-4c1a-8e16-b72e37550440 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:32.816109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:32.816752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:32.817081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:32.817321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:32.820034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:32.825269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:32.826921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:32.838428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:32.839705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:32.841436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 626/1239] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:32.846210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:32.963863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1b61-8fd0-4f93-a943-c48e508ae011 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:33.001850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:33.002690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:33.003063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:33.003432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:33.004334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:33.004738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:33.006314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:33.024634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 614/1240] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:33.030703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:33.138474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a443d5-7d88-4b6e-b247-752485da17cb None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:33.176407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:33.177233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:33.177552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:33.177794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:33.257015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:33.264170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:33.265697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:33.374607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 627/1241] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:35:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:33.380871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:33.411025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:33.493329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ce0f-5f43-47d6-81c3-4f34b4124f41 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:33.533518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:33.534160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:33.534436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:33.534708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:33.545121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:33.546616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:33.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:33.563173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:33.564690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:33.564690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:33.564690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:33.564690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 615/1242] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:33.569454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:33.668707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:33.674720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00706c5a-23be-41ee-b192-64bd2d387702 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:33.713197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:33.713873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:33.714129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:33.714442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:33.715034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:33.715369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:33.716746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:33.728080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 628/1243] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:33.734475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:33.815398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:33.838779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eecdf1-ecb1-41b8-88bd-09f6b28b6b43 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:33.878349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:33.879004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:33.879302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:33.879571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:33.886642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:33.888262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:33.901480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:33.902591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:33.903798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:33.907962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 616/1244] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:33.909002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:34.023180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d987de-87ca-4a5f-ba58-dbd8613f4647 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:34.066463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:34.067127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:34.067526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:34.067949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:34.068610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:34.068928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:34.070387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32360ce-d272-43d2-ab11-9070ea52d70c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:34.086911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 629/1245] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:34.093483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:34.208608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa94fb-77f5-42cc-b4b7-b5dea503c094 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:34.243511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:34.244368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:34.244697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:34.245032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:34.246025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] RBAC: Adding query filter params (role.id=15ff0792d3924f59b623e13bd83d2de5, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=176b283110c240159bbc525fd6745f1a) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:34.246472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:34.248540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081259a-c581-4114-bba5-695aca8fe7a6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:34.255968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 617/1246] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:35:34 2022] GET /identity/v3/role_assignments?user.id=176b283110c240159bbc525fd6745f1a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=15ff0792d3924f59b623e13bd83d2de5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:36.201221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc83a-aa7f-4d19-906b-2276db87229e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:36.201824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc83a-aa7f-4d19-906b-2276db87229e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:36.201824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc83a-aa7f-4d19-906b-2276db87229e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:36.203175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 630/1247] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:36.209216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:36.209841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:36.209952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:36.218459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:36.234777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:36.236159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:36.315554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 618/1248] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:36.587883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc83a-aa7f-4d19-906b-2276db87229e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:36.607108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:36.697736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdc83a-aa7f-4d19-906b-2276db87229e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:36.734677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:36.735329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:36.735602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:36.735869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:36.748702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:36.758358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:36.759604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:36.760641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 631/1249] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 15:35:36.766912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:36.878277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9656fe-b48d-4d8a-8acd-fa9ce2ca8cbd None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:36.911648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:36.917164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:36.917817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:36.918177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:36.918461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:36.919134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:36.919455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:36.921000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:36.929751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 619/1250] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:35:36.935836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:37.019217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:37.047986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005cde7-121c-47f8-989b-ef24a1cd2b51 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:37.084761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:37.085520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:37.085805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:37.086067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:37.098161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:37.099826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:37.115418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:37.116562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:37.117726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:37.117726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:37.117726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:37.117726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 632/1251] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:37.123126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:37.248578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71bdf-2d74-4194-b1c5-3587ddd4c4a6 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:37.290365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:37.291019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:37.291334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:37.291755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:37.292388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:37.292747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:37.294425 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:37.307202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 620/1252] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:37.316225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:37.425059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd579-771f-4045-b967-7c0b20a0a0bd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:37.451483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:37.460361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:37.461059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:37.461333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:37.461601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:37.469943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:37.471532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:37.484856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:37.486225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:37.487230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 633/1253] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:37.493434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:37.555796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:37.607740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb63c58-4132-4aa5-b93c-5e1eeb4578ad None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:37.645857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:37.646508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:37.646794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:37.647056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:37.647897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:37.648233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:37.650117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:37.670884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 621/1254] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:37.677604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:37.778734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f184cbf-6e72-4152-a83d-333143f6b26c None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:37.816534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:37.817230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:37.817545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:37.817849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:37.884238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:37.898983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:37.900468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.005861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 634/1255] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:35:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:38.012142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:38.125645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012d7c6-f76e-4a5c-9abe-2b86b76021af None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:38.139775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:38.164937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:38.166034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:38.166466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:38.166946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:38.180170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:38.182256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:38.200105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:38.201779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:38.202716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:38.202716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:38.202716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:38.202716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 622/1256] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:38.208626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:38.299031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:38.312059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93424f36-a06d-4c81-9e6d-b62d62f8e9fd None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:38.346039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:38.346706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:38.346954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:38.347206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:38.347861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:38.348156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:38.349624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.361924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 635/1257] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:38.368531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:38.475314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff80ef-29d0-4661-8b89-7d117eed6f38 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:38.514672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:38.515507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:38.515857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:38.516092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:38.524210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:38.525934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:38.538240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:38.539341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:38.540323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 623/1258] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:38.545603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:38.652536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0acfc9-9b1b-4de4-87f5-c15bd3191b46 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:38.689985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:38.690594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:38.690857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:38.691124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:38.691897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:38.692224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:38.693820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7e38-e598-474c-944d-6084ffe156fe None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.706961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 636/1259] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:38.714038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:38.742598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:38.824155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fab79-5037-48a1-87aa-f5bc429d8288 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:38.860055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:38.860668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:38.861029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:38.861310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:38.862097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=176b283110c240159bbc525fd6745f1a) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:38.862400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:38.863839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a9404-a891-4e1f-8654-4a5532e7417d None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:38.870450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 624/1260] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:35:38 2022] GET /identity/v3/role_assignments?user.id=176b283110c240159bbc525fd6745f1a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:40.751140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f428-0922-49f9-9224-bfc78c9ba92b None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:40.751709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f428-0922-49f9-9224-bfc78c9ba92b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:40.751709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6f428-0922-49f9-9224-bfc78c9ba92b None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:40.753072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 637/1261] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:40.759245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:40.760025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:40.760176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:40.782064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:40.783260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:40.853552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 625/1262] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:41.121933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f428-0922-49f9-9224-bfc78c9ba92b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:41.134413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:41.255560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6f428-0922-49f9-9224-bfc78c9ba92b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:41.291633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:41.292260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:41.292537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:41.292813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:41.303015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:41.307700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:41.308763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:41.309925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 638/1263] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:41.317807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:41.340169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:41.424961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86c08-4cec-4616-be66-d7b431d53607 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:41.460923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:41.461523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:41.461792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:41.462055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:41.462713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:41.463000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:41.464401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:41.472462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 626/1264] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:41.479185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:41.555711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:41.593506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579053a-174a-4546-871f-de9c40f74c05 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:41.628399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:41.629070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:41.629347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:41.629617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:41.640002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:41.641537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:41.658032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:41.659035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:41.659962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:41.659962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:41.659962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:41.659962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 639/1265] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:41.665278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:41.745044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:41.765730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663365a9-b7d5-4e6e-8c28-cdce060e3bdf None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:41.800506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:41.801126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:41.801404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:41.801673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:41.802315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:41.802616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:41.803992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:41.816265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 627/1266] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:41.822187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:41.936798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc355059-98b0-4a6c-beb9-31fd398a0c3b None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:41.956853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:41.978358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:41.979344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:41.979752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:41.980151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:41.988452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:41.989964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:42.001355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:42.002454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:42.003560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 640/1267] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:42.008345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.109657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff7179-4a1b-44ba-9ef5-5f6c3c14d6e5 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:42.150903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:42.151510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:42.151786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:42.152059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:42.152811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:42.153107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:42.154627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.164075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:42.173541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 628/1268] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:42.179588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.286076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1deae-406f-4214-be83-595b2dfba1ce None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:42.321678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:42.322305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:42.322571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:42.322831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:42.333736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:42.335180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:42.349740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:42.350801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:42.351963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:42.351963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:42.351963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:42.351963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 641/1269] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:42.357494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.468831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b36252-9df8-44c2-9f92-863437b502cc None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:42.507964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:42.508561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:42.508835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:42.509138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:42.509778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:42.510069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:42.511448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.522886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 629/1270] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:42.529569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.566933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:42.648879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ae5a7-e5f3-4164-8ace-77e52bcfccb5 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:42.694614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:42.695242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:42.695515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:42.695782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:42.702721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:42.704174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:42.715435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:42.716472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:42.717618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 642/1271] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:42.724416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.788359 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:42.835379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ecb7d-54d7-4641-9896-6b5e61f9b77e None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:42.871039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:42.871653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:42.871950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:42.872218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:42.872937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:42.873236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:42.874676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25db081-b5e9-4467-a6ee-f5036d58ace1 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:42.886375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 630/1272] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:42.893272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:42.986176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:42.995426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efd0f5-7b98-4f02-a423-acf9b00ab424 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:43.029942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:43.030589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:43.030859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:43.031126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] PATH_INFO: `/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/176b283110c240159bbc525fd6745f1a/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:43.033144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] RBAC: Authorizing `identity:create_grant(project_id=f01959633ac24d5abc4182c7827a5aa8, user_id=176b283110c240159bbc525fd6745f1a, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:43.034600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266c016-0e45-44a2-8606-cdc0dc849304 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:43.050337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 643/1273] 10.222.0.93 () {58 vars in 1439 bytes} [Wed Aug 24 15:35:42 2022] PUT /identity/v3/projects/f01959633ac24d5abc4182c7827a5aa8/users/176b283110c240159bbc525fd6745f1a/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:35:44.916380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059a11-85be-4500-a922-09258b82cae3 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:44.917291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059a11-85be-4500-a922-09258b82cae3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:44.917291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059a11-85be-4500-a922-09258b82cae3 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:44.919369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 631/1274] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:44.928154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:44.928566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:44.928734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:44.952077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:44.953288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:45.021481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 644/1275] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:45.295282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059a11-85be-4500-a922-09258b82cae3 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:45.406799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059a11-85be-4500-a922-09258b82cae3 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:45.425123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:45.443565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:45.444219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:45.444496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:45.444764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:45.455643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 15:35:45.460408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:45.461588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:45.462614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 632/1276] 10.222.0.93 () {56 vars in 1096 bytes} [Wed Aug 24 15:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:45.467966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:45.588382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:45.618499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ef387-52f6-4b85-8521-774d115d602b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:45.655804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:45.656403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:45.656678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:45.656976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:45.657637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:45.657936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:45.659298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:45.667590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 645/1277] 10.222.0.93 () {56 vars in 1099 bytes} [Wed Aug 24 15:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:45.674656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:45.777779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509dc8f-ee07-49e7-8c2f-c1581b0a0d05 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:45.813522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:45.814147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:45.814423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:45.814690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:45.825916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:45.827368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:45.842094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:45.843324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:45.844616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:45.844616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:45.844616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:45.844616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 633/1278] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:45.849520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:45.962411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e422-955b-4158-9401-53ba6d8c5eb1 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:45.996403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:45.997078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:45.997351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:45.997619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:45.998254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:45.998557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:45.999953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:46.011539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 646/1279] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:46.018765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:46.058490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:46.134827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903cc95-db24-4f3f-ac93-37418e4050bf None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:46.177995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:46.178777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:46.179060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:46.179428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] PATH_INFO: `/v3/users/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:46.188156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:46.189651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 15:35:46.201729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:46.202851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:46.203839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 634/1280] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:46.208928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:46.212914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:46.321167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d84d6-e76c-4bca-b5e5-f9ee98dc7e90 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:46.358086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:46.358687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:46.358956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:46.359219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:46.359939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:46.360230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:46.361697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:46.384044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 647/1281] 10.222.0.93 () {56 vars in 1143 bytes} [Wed Aug 24 15:35:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:46.392759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:46.489029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:46.506674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c757b7-94ea-4cbc-8e93-b726733646db None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:46.547797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:46.548397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:46.548672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:46.548945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:46.631954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:46.633435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:46.725568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:46.737128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 635/1282] 10.222.0.93 () {58 vars in 1282 bytes} [Wed Aug 24 15:35:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:46.743069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:46.819608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:46.861412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e71bf-b17f-4001-881d-eebe4d43c39d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:46.905034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:46.905663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:46.905934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:46.906198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:46.916738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:46.918219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 15:35:46.933791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:46.934908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 15:35:46.935989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 15:35:46.935989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 15:35:46.935989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:46.935989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 648/1283] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:46.941006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:47.042381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05cf9-c64c-42c0-8e55-dad0cd71c41c None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:47.077341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:47.077938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:47.078210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:47.078478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:47.079112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:47.079409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:47.080769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:47.092089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 636/1284] 10.222.0.93 () {56 vars in 1109 bytes} [Wed Aug 24 15:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:47.097814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:47.205590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a246-ec3d-42ce-89c7-b12fdb72b886 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:47.220138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:47.241481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:47.242110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:47.242386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:47.242652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:47.249333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:47.250827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 15:35:47.261844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:47.262924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: ERROR keystone.server.flask.application Aug 24 15:35:47.264438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 649/1285] 10.222.0.93 () {56 vars in 1111 bytes} [Wed Aug 24 15:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:47.272538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:47.333843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:47.389217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e3d4-5567-4982-90de-8d88c1ef97c9 None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:47.425013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:47.425611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:47.425885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:47.426157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:47.426846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:47.427148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:47.428586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ea0ff-f885-48cc-9faa-d2e4ae44b693 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:47.441734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 637/1286] 10.222.0.93 () {56 vars in 1148 bytes} [Wed Aug 24 15:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:47.448832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:47.557348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dad0d-f205-4d0b-87a1-d628d01b004d None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:47.597569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:47.598090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:47.598366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:47.598627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:47.599351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] RBAC: Adding query filter params (role.id=4d4c76bf767c44dea45214aa522e6f3e, scope.project.id=f01959633ac24d5abc4182c7827a5aa8, user.id=176b283110c240159bbc525fd6745f1a) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:47.599621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:47.601125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664cd1b-41b6-4dc1-a5e3-d36037a9ff39 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:47.607444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 650/1287] 10.222.0.93 () {56 vars in 1374 bytes} [Wed Aug 24 15:35:47 2022] GET /identity/v3/role_assignments?user.id=176b283110c240159bbc525fd6745f1a&scope.project.id=f01959633ac24d5abc4182c7827a5aa8&role.id=4d4c76bf767c44dea45214aa522e6f3e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:49.513740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420173-1e7f-463e-b7f4-6b4c95fe4af1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:49.514677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420173-1e7f-463e-b7f4-6b4c95fe4af1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:49.514677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420173-1e7f-463e-b7f4-6b4c95fe4af1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:49.516786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 638/1288] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:49.522230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:49.522665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:49.522767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:49.542977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:49.544243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:49.574216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:49.614347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 651/1289] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 15:35:49.880238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420173-1e7f-463e-b7f4-6b4c95fe4af1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:49.996595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420173-1e7f-463e-b7f4-6b4c95fe4af1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:50.009358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:50.038762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:50.039399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:50.039672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:50.039935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:50.040527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:50.041924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:50.051460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:50.052643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:50.053900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 639/1290] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:35:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:50.062214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:50.161678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52200ffd-6f1d-4a33-90f6-9dfc3e361dbf None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:50.199792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:50.200739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:50.201126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:50.201464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:50.202328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:50.202634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:50.204665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70b04-8302-42b7-ba34-4eb72b17f45d None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:50.211295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 652/1291] 10.222.0.93 () {56 vars in 1116 bytes} [Wed Aug 24 15:35:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:50.217899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:50.326869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c388e-16f4-4b26-a35c-df79a4e5969a None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:50.370216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:50.370914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:50.371188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:50.371456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] PATH_INFO: `/v3/services` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:50.372072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:50.372364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:50.373758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d089a00-7d84-48e9-b6e1-1911bd579772 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:50.378354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 640/1292] 10.222.0.93 () {56 vars in 1116 bytes} [Wed Aug 24 15:35:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:52.246404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040078-a258-4911-a06d-b12423bb1f10 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:52.246907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040078-a258-4911-a06d-b12423bb1f10 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:52.246907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040078-a258-4911-a06d-b12423bb1f10 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:52.248352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 653/1293] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:52.254571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c143ee-579c-448b-b0b1-6283ab5b5c47 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:52.255321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c143ee-579c-448b-b0b1-6283ab5b5c47 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:52.255485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c143ee-579c-448b-b0b1-6283ab5b5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:52.283145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-88c143ee-579c-448b-b0b1-6283ab5b5c47 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:52.284343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-88c143ee-579c-448b-b0b1-6283ab5b5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:52.316217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:52.355786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 641/1294] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:52.617720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3040078-a258-4911-a06d-b12423bb1f10 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:52.657733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:52.730858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3040078-a258-4911-a06d-b12423bb1f10 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:52.765787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:52.766393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:52.766671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:52.766938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:52.767587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:52.768971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115422a2-c281-42f0-aaea-1bb873b7cc04 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:52.791438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 654/1295] 10.222.0.93 () {60 vars in 1141 bytes} [Wed Aug 24 15:35:52 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:35:54.683271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951e87-cccd-491d-afec-fb4fe6f77468 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:54.684178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951e87-cccd-491d-afec-fb4fe6f77468 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:54.684664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951e87-cccd-491d-afec-fb4fe6f77468 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:54.686912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 642/1296] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:54.696020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:54.696443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:54.696614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:54.717389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:54.718577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:54.799245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 655/1297] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:55.070585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1951e87-cccd-491d-afec-fb4fe6f77468 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:55.179827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1951e87-cccd-491d-afec-fb4fe6f77468 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:55.221360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:55.222070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:55.222259 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:55.222525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:55.223333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:55.224944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:55.236381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:55.237999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:55.239476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 643/1298] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:35:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:55.243861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:55.264737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:55.349487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6e64-59ce-4072-9c07-6dff1da24f4d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:55.385927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:55.386535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:55.386810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:55.387073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:55.387735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:55.388034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:55.389447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:55.394965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 656/1299] 10.222.0.93 () {56 vars in 1116 bytes} [Wed Aug 24 15:35:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:55.401674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:55.434800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:55.506284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829066db-25f8-4d97-9834-e6ee1a05fcfa None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:55.541648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:55.542238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:55.542511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:55.542780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:55.543484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] RBAC: Adding query filter params (interface=public, service_id=7d167d6ebb7e47428bf2b4df41460765, region_id=RegionOne) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:55.543796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:55.545260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32f7a3-a63a-4e44-93fd-f6b062c4ed54 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:55.550366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 644/1300] 10.222.0.93 () {56 vars in 1251 bytes} [Wed Aug 24 15:35:55 2022] GET /identity/v3/endpoints?service_id=7d167d6ebb7e47428bf2b4df41460765&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:55.556746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:55.650859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:55.672003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb908c7-6598-4b2b-afb9-24dd7317e8d9 None admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:55.706962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:55.707676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:55.707783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:55.708055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:55.708679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:55.710092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc3146-e17d-4712-a8f0-da3d7f001249 None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:55.716939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 657/1301] 10.222.0.93 () {56 vars in 1087 bytes} [Wed Aug 24 15:35:55 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:35:57.604699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbf4f-8ee9-43b3-b315-de1ecf7f71ab None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:57.605867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbf4f-8ee9-43b3-b315-de1ecf7f71ab None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:57.605867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbf4f-8ee9-43b3-b315-de1ecf7f71ab None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:57.607737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 645/1302] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:35:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:35:57.613150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:57.613593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:57.613685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:57.633404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:35:57.634579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:35:57.716707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 658/1303] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:35:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 15:35:57.988917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbf4f-8ee9-43b3-b315-de1ecf7f71ab None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:58.092502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:58.104769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbf4f-8ee9-43b3-b315-de1ecf7f71ab None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:58.149621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:58.150245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:58.150519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:58.150783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:58.151368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:58.152738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 15:35:58.161887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 15:35:58.163054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application with Lock( Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self._enter() Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application return self.creator() Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application created_value = creator( Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: ERROR keystone.server.flask.application Aug 24 15:35:58.164103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 646/1304] 10.222.0.93 () {56 vars in 1117 bytes} [Wed Aug 24 15:35:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 15:35:58.170679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:58.251574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:58.284586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353dd39-f4f6-4b12-aa9c-69c85327e136 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:58.327576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:58.328188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:58.328458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:58.328723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] PATH_INFO: `/v3/services` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:58.329377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] RBAC: Adding query filter params (name=placement) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:35:58.329675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:58.331053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0328-e773-4452-9f31-70b759082acd None admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:58.336709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 659/1305] 10.222.0.93 () {56 vars in 1116 bytes} [Wed Aug 24 15:35:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:35:58.342841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:35:58.449476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a80a8-e3da-42fd-b567-714ffff843ae None admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:35:58.490460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:35:58.491060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:35:58.491340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:35:58.491611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:35:58.492267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:35:58.493674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aaa81-4a80-4852-b64c-9768856b5311 None admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:35:58.517252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 647/1306] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:35:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:36:08.333409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=30 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:08.513091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:02.189307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e4c-c82a-4209-b75a-bc2609fac0a4 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:02.190385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e4c-c82a-4209-b75a-bc2609fac0a4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:02.190897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e4c-c82a-4209-b75a-bc2609fac0a4 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:02.196493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 660/1307] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:02.197951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27699-8d7f-4d99-992b-8867e19c2cd3 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:02.198739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27699-8d7f-4d99-992b-8867e19c2cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:02.199160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27699-8d7f-4d99-992b-8867e19c2cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:02.304141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f3e27699-8d7f-4d99-992b-8867e19c2cd3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:02.306840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f3e27699-8d7f-4d99-992b-8867e19c2cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:02.458442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 648/1308] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:02.733952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:02.734291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:02.734563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:02.736320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 661/1309] 10.222.0.93 () {54 vars in 965 bytes} [Wed Aug 24 15:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:02.742623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064017-204c-46ec-8cc0-349b620a085b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:02.742950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064017-204c-46ec-8cc0-349b620a085b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:02.743226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064017-204c-46ec-8cc0-349b620a085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:02.823031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-aa064017-204c-46ec-8cc0-349b620a085b None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:02.824229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-aa064017-204c-46ec-8cc0-349b620a085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:02.845473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:02.912326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 649/1310] 10.222.0.93 () {58 vars in 1062 bytes} [Wed Aug 24 15:37:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:02.921392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:02.923183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:03.036582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d85a7-6f11-4bfc-abf6-eb3a1e6d9832 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:03.108676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:03.109405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:03.109705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:03.109957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:03.111527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:03.171373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:03.239224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:03.240690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e90f-cfe4-4eb8-ba9a-3e80ec5d50e6 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:03.261900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 662/1311] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:05.452518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:05.453179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:05.453179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:05.455712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 650/1312] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:05.461232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99fcf-e7f0-41bf-9e44-a0dba8406f94 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:05.461687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99fcf-e7f0-41bf-9e44-a0dba8406f94 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:05.461799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99fcf-e7f0-41bf-9e44-a0dba8406f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:05.537405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-96c99fcf-e7f0-41bf-9e44-a0dba8406f94 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:05.538955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-96c99fcf-e7f0-41bf-9e44-a0dba8406f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:05.661700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 663/1313] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:05.932964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:05.934518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:06.043229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d0e5f-bb72-46f7-b482-c113b2c576a1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:06.119684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:06.122371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:06.123018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:06.123634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:06.124161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:06.126194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:06.238232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:06.239694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b45d8-0d46-4eb3-917d-7bf8cb093865 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:06.263183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 651/1314] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:08.490635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:08.491214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:08.491214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:08.492589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 664/1315] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:08.498238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158349e5-6253-4677-8989-38f92fac5eae None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:08.498663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158349e5-6253-4677-8989-38f92fac5eae None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:08.498777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158349e5-6253-4677-8989-38f92fac5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:08.567679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-158349e5-6253-4677-8989-38f92fac5eae None None] MFA Rules not processed for user `a8ab08e9e37e4319ac078f0ddc4dab0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:08.568998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-158349e5-6253-4677-8989-38f92fac5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:08.621874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:08.668133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 652/1316] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:08.949941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:08.952627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:08.963049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:09.067220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29fa40-e29a-4040-b512-49c31c5f55b1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:09.143141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:09.143747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:09.144021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:09.144287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:09.145910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:09.211434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:09.260338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:09.261813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71251dc2-a703-43a2-8192-d959770f43b8 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:09.280238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 665/1317] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:11.740772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:11.741745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:11.741745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:11.744020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 653/1318] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:11.749778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0a50-971c-4917-ad64-63fd02b70a62 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:11.750206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0a50-971c-4917-ad64-63fd02b70a62 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:11.750342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0a50-971c-4917-ad64-63fd02b70a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:11.828194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-80fe0a50-971c-4917-ad64-63fd02b70a62 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:11.829448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-80fe0a50-971c-4917-ad64-63fd02b70a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:11.930863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 666/1319] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:12.210246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:12.212781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:12.324774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf68b95-48ef-4b39-830b-f5d0077d2619 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:12.402323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:12.402934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:12.403212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:12.403480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:12.405102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:12.412957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:12.522192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:12.523639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfb729-4f35-49f6-bbec-9643239f1b29 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:12.544651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 654/1320] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:15.088133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3b33-f956-4728-b9b4-4e06f88e42aa None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:15.088747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3b33-f956-4728-b9b4-4e06f88e42aa None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:15.088747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f3b33-f956-4728-b9b4-4e06f88e42aa None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:15.090070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 667/1321] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:15.095870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea217f4-22b1-45e4-b5e7-a7db829d0758 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:15.096306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea217f4-22b1-45e4-b5e7-a7db829d0758 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:15.096497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea217f4-22b1-45e4-b5e7-a7db829d0758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:15.163495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-dea217f4-22b1-45e4-b5e7-a7db829d0758 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:15.164659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dea217f4-22b1-45e4-b5e7-a7db829d0758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:15.228552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:15.268400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 655/1322] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:15.561138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:15.561373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:15.561680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:15.563116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 668/1323] 10.222.0.93 () {54 vars in 965 bytes} [Wed Aug 24 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:15.569243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea29b0-9bcb-4a1d-a049-da35718c1f80 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:15.569608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea29b0-9bcb-4a1d-a049-da35718c1f80 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:15.569951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea29b0-9bcb-4a1d-a049-da35718c1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:15.648838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-00ea29b0-9bcb-4a1d-a049-da35718c1f80 None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:15.650429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-00ea29b0-9bcb-4a1d-a049-da35718c1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:15.731320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 656/1324] 10.222.0.93 () {58 vars in 1062 bytes} [Wed Aug 24 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:15.739937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:15.741514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:15.761911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:15.849088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d56e22-6dd5-412a-aff9-76752735369e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:15.926083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:15.926689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:15.926930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:15.927227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:15.928813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:16.004683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:16.045310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:16.046866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb660f-bc38-42f9-971a-2ef72cc1a4b1 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:16.068931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 669/1325] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:18.240654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:18.241249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:18.241249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:18.242584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 657/1326] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:18.248082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe3f5-39bc-4772-92a5-1af6d9418033 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:18.248557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe3f5-39bc-4772-92a5-1af6d9418033 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:18.248661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe3f5-39bc-4772-92a5-1af6d9418033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:18.318031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1dbfe3f5-39bc-4772-92a5-1af6d9418033 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:18.319643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1dbfe3f5-39bc-4772-92a5-1af6d9418033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:18.423995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 670/1327] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:18.700326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:18.701910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:18.763084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:18.808433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ce578-9b53-4d34-a87d-b1576149d00c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:18.882964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:18.883612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:18.883886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:18.884118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:18.885959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:19.000879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:19.003736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:19.005241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a09aa-a86d-4e9d-9a20-3272a3cfe0fa service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:19.024377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 658/1328] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:20.958378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:20.958961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:20.958961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:20.960273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 671/1329] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:20.966142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4a338-7f6b-430b-ba5a-1f37480849d8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:20.966703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4a338-7f6b-430b-ba5a-1f37480849d8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:20.966703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4a338-7f6b-430b-ba5a-1f37480849d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:21.037227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e4f4a338-7f6b-430b-ba5a-1f37480849d8 None None] MFA Rules not processed for user `a8ab08e9e37e4319ac078f0ddc4dab0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:21.038420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e4f4a338-7f6b-430b-ba5a-1f37480849d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:21.161336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 659/1330] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:21.443051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:21.444600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:21.482940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:21.563844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e4051-2f15-4813-bc37-35836ff4c7ed None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:21.642765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:21.643389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:21.643664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:21.643931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:21.645593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:21.730384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:21.764069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:21.765615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640498f0-c71b-439e-aa6f-9a2308f8149e service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:21.785922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 672/1331] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:24.084090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:24.084518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:24.084618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:24.086329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 660/1332] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:24.091746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ccfe-5b31-4e3b-9218-e1d45570a32e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:24.092203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ccfe-5b31-4e3b-9218-e1d45570a32e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:24.092312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ccfe-5b31-4e3b-9218-e1d45570a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:24.162666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4a58ccfe-5b31-4e3b-9218-e1d45570a32e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:24.164141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4a58ccfe-5b31-4e3b-9218-e1d45570a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:24.270491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 673/1333] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:24.549286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:24.551751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:24.632886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:24.677142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515da7d-2cc9-475e-91e8-72f1c2935013 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:24.753584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:24.754180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:24.754453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:24.754721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:24.756300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:24.877184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:24.878515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06142757-fff2-4c33-9ae6-62eb1833e0f1 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:24.888870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:24.897835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 661/1334] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:26.833191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:26.833804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:26.833916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:26.835277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 674/1335] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:26.841898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e407c6-7069-4d5f-ac58-cd66015405a0 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:26.842650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e407c6-7069-4d5f-ac58-cd66015405a0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:26.842795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e407c6-7069-4d5f-ac58-cd66015405a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:26.918497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-67e407c6-7069-4d5f-ac58-cd66015405a0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:26.919683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-67e407c6-7069-4d5f-ac58-cd66015405a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:27.023774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 662/1336] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:27.308244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:27.310773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:27.354130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:27.437528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28007b50-2439-480c-af69-e8372c66ac6e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:27.512806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:27.513432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:27.513704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:27.513971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:27.515568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:27.599980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:27.629845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:27.631296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc65da-0729-4846-9d7c-cd2e3c4a9114 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:27.652634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 675/1337] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:29.975278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:29.976169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:29.976169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:29.978337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 663/1338] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:29.984438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540bdb5-b79d-4efe-b0c4-0aadf5c3b02c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:29.984947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540bdb5-b79d-4efe-b0c4-0aadf5c3b02c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:29.985063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540bdb5-b79d-4efe-b0c4-0aadf5c3b02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:30.056865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2540bdb5-b79d-4efe-b0c4-0aadf5c3b02c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:30.058111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2540bdb5-b79d-4efe-b0c4-0aadf5c3b02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:30.169022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 676/1339] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:30.448300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:30.450808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:30.536752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:30.575430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565339a-cde3-4469-a1f6-e61301a39310 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:30.658708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:30.659340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:30.659606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:30.659871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:30.661512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:30.774031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:30.775839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1229e97-cb29-4c37-b288-11bd911fd5d9 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:30.797802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 664/1340] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:34.697453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:34.697969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:34.697969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:34.699360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 677/1341] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:34.704711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e49de-8913-405d-85a3-57a7faf79b82 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:34.705176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e49de-8913-405d-85a3-57a7faf79b82 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:34.705301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e49de-8913-405d-85a3-57a7faf79b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:34.710833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:34.773474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2e1e49de-8913-405d-85a3-57a7faf79b82 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:34.775023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2e1e49de-8913-405d-85a3-57a7faf79b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:34.876156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 665/1342] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:35.151824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:35.153428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:35.207883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:35.269589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06868ab9-5898-4091-b204-d5a0b075af9b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:35.345798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:35.346406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:35.346676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:35.346936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:35.348506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:35.444696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:35.461048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:35.462482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814480-c098-4989-946d-1d74aa123dd3 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:35.480853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 678/1343] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:38.006270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:38.006840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:38.006840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:38.008304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 666/1344] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:38.013600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fa7-aee1-41fc-804d-a4ac0d258f20 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:38.014031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fa7-aee1-41fc-804d-a4ac0d258f20 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:38.014178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b90fa7-aee1-41fc-804d-a4ac0d258f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:38.085417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d7b90fa7-aee1-41fc-804d-a4ac0d258f20 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:38.086606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d7b90fa7-aee1-41fc-804d-a4ac0d258f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:38.188768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 679/1345] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:38.472740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:38.474382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:38.563257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:38.580594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb7dc-acaa-4e1c-9e5c-679c579df4d7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:38.666415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:38.667026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:38.667283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:38.667572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:38.669258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:38.784474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:38.786115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555746-94c9-4302-9921-5479095d7831 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:38.805508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 667/1346] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:42.943216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:42.943747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:42.943747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:42.945280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 680/1347] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:42.950902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a069e-1605-4071-82dc-1efda774a299 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:42.951373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a069e-1605-4071-82dc-1efda774a299 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:42.951452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a069e-1605-4071-82dc-1efda774a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:42.968231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:43.023242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-636a069e-1605-4071-82dc-1efda774a299 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:43.024789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-636a069e-1605-4071-82dc-1efda774a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:43.126343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 668/1348] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:43.408655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:43.410251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:43.471618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:43.525705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04515480-1581-45dd-ac7f-13c2b101e464 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:43.617485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:43.618132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:43.618393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:43.618678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:43.620246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:43.732564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:43.737072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:43.738795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f59021-e847-49c4-acda-2f63ae69dcd7 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:43.757386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 681/1349] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:37:48.671680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446c28-1f0e-4820-b35b-d5db8e98a235 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:48.672197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446c28-1f0e-4820-b35b-d5db8e98a235 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:48.672197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67446c28-1f0e-4820-b35b-d5db8e98a235 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:48.673602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 669/1350] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:48.678670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16514e5-7b06-4290-b2ae-7637a39f9225 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:48.679112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16514e5-7b06-4290-b2ae-7637a39f9225 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:48.679201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16514e5-7b06-4290-b2ae-7637a39f9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:48.819551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c16514e5-7b06-4290-b2ae-7637a39f9225 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:48.820763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c16514e5-7b06-4290-b2ae-7637a39f9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:48.943637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 682/1351] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:37:53.019982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47594d2-4ba8-4e8b-8004-b643472870db None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:53.020887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47594d2-4ba8-4e8b-8004-b643472870db None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:53.021332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47594d2-4ba8-4e8b-8004-b643472870db None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:53.023089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 670/1352] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:53.028366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e4c1-51c0-409a-8e48-2308371d8d6b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:53.028827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e4c1-51c0-409a-8e48-2308371d8d6b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:53.028941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1e4c1-51c0-409a-8e48-2308371d8d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:53.084995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:53.109014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ffd1e4c1-51c0-409a-8e48-2308371d8d6b None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:53.110224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ffd1e4c1-51c0-409a-8e48-2308371d8d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:53.124468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=59 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:53.224798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 683/1353] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:54.546710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9300-60f6-410f-ae73-59b94c554ab1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:54.547332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9300-60f6-410f-ae73-59b94c554ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:54.547332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9300-60f6-410f-ae73-59b94c554ab1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:54.548580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 671/1354] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:54.553936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aad21-f257-4c0e-b5a8-61068da5e392 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:54.554389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aad21-f257-4c0e-b5a8-61068da5e392 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:54.554576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aad21-f257-4c0e-b5a8-61068da5e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:54.631680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2e7aad21-f257-4c0e-b5a8-61068da5e392 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:54.632865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2e7aad21-f257-4c0e-b5a8-61068da5e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:54.675094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:54.743227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 684/1355] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:58.007357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736effbd-5bb0-4dd2-871d-7f3bf6ef687c None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:58.007931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736effbd-5bb0-4dd2-871d-7f3bf6ef687c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:58.007931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736effbd-5bb0-4dd2-871d-7f3bf6ef687c None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:58.009598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 672/1356] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:58.016401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed0c-df45-429e-951e-2e0553846419 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:58.016847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed0c-df45-429e-951e-2e0553846419 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:58.016847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed0c-df45-429e-951e-2e0553846419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:58.107660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fab3ed0c-df45-429e-951e-2e0553846419 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:58.109971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fab3ed0c-df45-429e-951e-2e0553846419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:58.228963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 685/1357] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:58.519552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:58.519955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:58.520301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:58.521753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 673/1358] 10.222.0.93 () {54 vars in 962 bytes} [Wed Aug 24 15:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:37:58.531397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ec9a-2040-4387-9b75-065e757a713a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:58.531810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ec9a-2040-4387-9b75-065e757a713a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:58.533513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ec9a-2040-4387-9b75-065e757a713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:58.552661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:58.618700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2c86ec9a-2040-4387-9b75-065e757a713a None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:37:58.620036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2c86ec9a-2040-4387-9b75-065e757a713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:58.738848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 686/1359] 10.222.0.93 () {58 vars in 1059 bytes} [Wed Aug 24 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:37:58.750272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:37:58.751693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:58.911083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde82e7-bf86-4c87-992e-fadef04145fe None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:37:58.993430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:59.037183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:37:59.037821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:37:59.038320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:37:59.038686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:37:59.040630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:37:59.139054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:37:59.140982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5120c6-e120-46f9-8b6e-4aa0f697b119 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:37:59.162257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 674/1360] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:01.261943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:01.262512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:01.262512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:01.263951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 687/1361] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:01.269277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1857-8992-4ecd-8ebe-6ca7cfa28ea8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:01.269748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1857-8992-4ecd-8ebe-6ca7cfa28ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:01.269925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe1857-8992-4ecd-8ebe-6ca7cfa28ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:01.339034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-72fe1857-8992-4ecd-8ebe-6ca7cfa28ea8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:01.340247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-72fe1857-8992-4ecd-8ebe-6ca7cfa28ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:01.382083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:01.456952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 675/1362] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:01.739451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:01.741136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:01.812372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:01.897395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c675d1-d647-4e2b-9962-1220361c8b89 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:02.013549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:02.014207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:02.014736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:02.014947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:02.016785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:02.044174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:02.118528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:02.120482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489feb3-c5dc-4f9d-adfc-77804a93bc52 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:02.140363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 688/1363] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:04.368566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d6fc-0212-4c5c-b2ac-ed60bb04d558 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:04.369471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d6fc-0212-4c5c-b2ac-ed60bb04d558 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:04.369931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063d6fc-0212-4c5c-b2ac-ed60bb04d558 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:04.371745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 676/1364] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:04.377603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f3af-433e-4803-bbe3-e67f04eb9777 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:04.378121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f3af-433e-4803-bbe3-e67f04eb9777 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:04.378121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768f3af-433e-4803-bbe3-e67f04eb9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:04.445822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5768f3af-433e-4803-bbe3-e67f04eb9777 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:04.447047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5768f3af-433e-4803-bbe3-e67f04eb9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:04.563675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:04.566465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 689/1365] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:04.852072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:04.852527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:04.853005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:04.854790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 677/1366] 10.222.0.93 () {54 vars in 962 bytes} [Wed Aug 24 15:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:04.859963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416aac5-8874-471b-a744-3d1f12a9174d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:04.860250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416aac5-8874-471b-a744-3d1f12a9174d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:04.860519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416aac5-8874-471b-a744-3d1f12a9174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:04.940125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a416aac5-8874-471b-a744-3d1f12a9174d None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:04.941540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a416aac5-8874-471b-a744-3d1f12a9174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:05.076096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 690/1367] 10.222.0.93 () {58 vars in 1059 bytes} [Wed Aug 24 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:05.084178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:05.085774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:05.256465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a19a9-c5f9-4cfd-a45d-d7d4c49207d3 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:05.278702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:05.375109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:05.375797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:05.376056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:05.376319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:05.378015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:05.472001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:05.474114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005054b-26bf-4078-a848-38457798ea93 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:05.496579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 678/1368] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:06.066020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b165077-a96d-4545-9264-c3f46dcc0c1e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:06.066852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b165077-a96d-4545-9264-c3f46dcc0c1e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:06.066852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b165077-a96d-4545-9264-c3f46dcc0c1e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:06.068186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 691/1369] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:06.073758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112ac3-32bd-4d2e-8823-613122884dca None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:06.074056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112ac3-32bd-4d2e-8823-613122884dca None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:06.074322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112ac3-32bd-4d2e-8823-613122884dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:06.110619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:06.143059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-18112ac3-32bd-4d2e-8823-613122884dca None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:06.144246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-18112ac3-32bd-4d2e-8823-613122884dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:06.258250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 679/1370] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:06.848438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:06.848438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:06.848438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:06.848438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 692/1371] 10.222.0.93 () {54 vars in 964 bytes} [Wed Aug 24 15:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:06.852503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044af4-4552-424e-a201-901ea2bb601d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:06.852503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044af4-4552-424e-a201-901ea2bb601d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:06.853251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044af4-4552-424e-a201-901ea2bb601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:06.932114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-65044af4-4552-424e-a201-901ea2bb601d None None] MFA Rules not processed for user `8620b3bc47e241b18a60bd7f43fd4f57`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:06.933495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-65044af4-4552-424e-a201-901ea2bb601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:06.983900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:07.016223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 680/1372] 10.222.0.93 () {58 vars in 1061 bytes} [Wed Aug 24 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:07.024167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:07.025749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:07.080106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:07.137335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a36fe-f60c-48da-90c5-43ce119a7750 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:07.226062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:07.226814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:07.227085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:07.227347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:07.228995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:07.329879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:07.344534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:07.345900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfbf99-0aed-4e24-8728-83432df16091 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:07.365246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 693/1373] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:07.443432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:07.444006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:07.444006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:07.449292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 681/1374] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:07.450778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1429df-663e-4872-a120-c86941af2dc8 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:07.451327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1429df-663e-4872-a120-c86941af2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:07.451327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1429df-663e-4872-a120-c86941af2dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:07.521466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9f1429df-663e-4872-a120-c86941af2dc8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:07.522405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9f1429df-663e-4872-a120-c86941af2dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:07.630017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 694/1375] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:07.918345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:07.919857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:08.075580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0afb09-065e-4689-af42-0195cdd400a6 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:08.141067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:08.215365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:08.215991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:08.216324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:08.216650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:08.218360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:08.312276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:08.313909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4c2d7-5c35-4276-8ebb-4d9444076dce service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:08.331929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 682/1376] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:10.269330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:10.269901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:10.270002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:10.271521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 695/1377] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:10.277405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4135f-210f-4cda-9077-f15fde8e64df None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:10.278235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4135f-210f-4cda-9077-f15fde8e64df None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:10.278810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4135f-210f-4cda-9077-f15fde8e64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:10.349661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-41f4135f-210f-4cda-9077-f15fde8e64df None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:10.350852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-41f4135f-210f-4cda-9077-f15fde8e64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:10.357698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:10.464964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 683/1378] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:10.752441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:10.754396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:10.839290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:10.953121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642fc93-ca73-4e11-9225-317dbba70d4f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:11.097476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:11.097990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:11.098405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:11.098670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:11.100241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:11.119609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:11.196760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:11.198388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8918e-2e91-44bb-9a4f-8c0896522079 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:11.224077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 696/1379] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:13.152197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:13.152768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:13.152768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:13.154369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 684/1380] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:13.159563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0a4a3-a724-48d6-8cf6-dfb3e04f0953 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:13.160034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0a4a3-a724-48d6-8cf6-dfb3e04f0953 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:13.160142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0a4a3-a724-48d6-8cf6-dfb3e04f0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:13.235588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1db0a4a3-a724-48d6-8cf6-dfb3e04f0953 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:13.236946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1db0a4a3-a724-48d6-8cf6-dfb3e04f0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:13.331978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:13.341142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 697/1381] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:13.625610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:13.627119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:13.786297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:13.797785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a9a56-25eb-4eb5-9328-c08714ca50d1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:13.920305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:13.920822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:13.921104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:13.921450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:13.923825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:14.015974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:14.017846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ab44f-87d5-4664-92a3-03ff9bc2364e service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:14.029200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:14.038731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 685/1382] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:16.239862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:16.240565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:16.240565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:16.241793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 698/1383] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:16.248079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03783669-a4a6-4346-8794-0a8171224abb None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:16.248540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03783669-a4a6-4346-8794-0a8171224abb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:16.248881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03783669-a4a6-4346-8794-0a8171224abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:16.330098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-03783669-a4a6-4346-8794-0a8171224abb None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:16.331899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-03783669-a4a6-4346-8794-0a8171224abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:16.446980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 686/1384] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:16.726479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:16.728272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:16.882642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9050a-5534-47d5-a096-ca48db981399 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:16.953181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:17.015465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:17.016125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:17.016376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:17.016609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:17.018257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:17.123192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:17.125712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4dfd1-30a2-4a44-a353-43d193f8f656 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:17.152380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 699/1385] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:38:19.049573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:19.050148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:19.050338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:19.052375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 687/1386] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:19.058140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03883a3-db45-4785-b002-d8cc5a816f3f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:19.058718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03883a3-db45-4785-b002-d8cc5a816f3f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:19.058718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03883a3-db45-4785-b002-d8cc5a816f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:19.134994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b03883a3-db45-4785-b002-d8cc5a816f3f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:19.136108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b03883a3-db45-4785-b002-d8cc5a816f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:19.171241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:19.249324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 700/1387] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:19.538169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:19.539820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:19.626219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:19.714786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39be025-8efa-4e19-96cd-433519d0f0f4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:19.832535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:19.833035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:19.833305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:19.833572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:19.835174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:19.875706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:19.929248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:19.930984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66328764-500b-458c-802b-9b31e7e1d20c service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:19.949179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 688/1388] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:21.954828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06cf-9b59-4785-ae1a-5275a573930e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:21.955430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06cf-9b59-4785-ae1a-5275a573930e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:21.955430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d06cf-9b59-4785-ae1a-5275a573930e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:21.956729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 701/1389] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:38:21.962451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542045c6-fd7f-47e4-9de4-d1539e1ec42c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:21.962937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542045c6-fd7f-47e4-9de4-d1539e1ec42c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:21.962937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542045c6-fd7f-47e4-9de4-d1539e1ec42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.031478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-542045c6-fd7f-47e4-9de4-d1539e1ec42c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:22.032693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-542045c6-fd7f-47e4-9de4-d1539e1ec42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.135933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 689/1390] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:22.270446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:22.270760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:22.271029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.272886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 702/1391] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:22.278504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968875-562b-4bff-9428-dcb5f89ad351 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:22.278786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968875-562b-4bff-9428-dcb5f89ad351 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:22.279054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89968875-562b-4bff-9428-dcb5f89ad351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.295117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:22.347914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-89968875-562b-4bff-9428-dcb5f89ad351 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:22.349172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-89968875-562b-4bff-9428-dcb5f89ad351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.421311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:22.422938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.454987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 690/1392] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:38:22.579156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c4a13-9c40-4a3b-a814-21d55f4d83df None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:22.595463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:22.695533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:22.696144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:22.696418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:22.696685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.698327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.755543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4790-c140-46cd-8da7-9855814daa79 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:22.755831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4790-c140-46cd-8da7-9855814daa79 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:22.756090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d4790-c140-46cd-8da7-9855814daa79 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.757506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 691/1393] 10.222.0.93 () {54 vars in 967 bytes} [Wed Aug 24 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:22.762294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beecea-752b-42b6-b495-ee8d616f2e0e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:22.762798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beecea-752b-42b6-b495-ee8d616f2e0e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:22.762798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beecea-752b-42b6-b495-ee8d616f2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:22.796777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:22.798628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:22.817139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 703/1394] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:22.844343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c0beecea-752b-42b6-b495-ee8d616f2e0e None None] MFA Rules not processed for user `284f6ac815d940ccb5f3dc7755bc201e`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:22.845589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c0beecea-752b-42b6-b495-ee8d616f2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.880505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:22.926903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 692/1395] 10.222.0.93 () {58 vars in 1064 bytes} [Wed Aug 24 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:38:22.934974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:22.936329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:22.961404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:23.021060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7fa1-fe87-4705-85d7-353821eb39df service nova] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:23.093733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:23.094408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:23.094609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:23.094883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:23.096473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:23.196265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:23.212693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:23.214261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e6b32-ef27-4148-a658-44d3eb281b16 service glance] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:23.233830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 704/1396] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:23.975226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3216-ff52-40d5-b645-0d64e88e0dbf None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:23.975760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3216-ff52-40d5-b645-0d64e88e0dbf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:23.975760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3216-ff52-40d5-b645-0d64e88e0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.044654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b6ae3216-ff52-40d5-b645-0d64e88e0dbf None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:24.045878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b6ae3216-ff52-40d5-b645-0d64e88e0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:24.137386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 693/1397] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:24.186728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:24.187589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:24.187923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.190010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 705/1398] 10.222.0.93 () {54 vars in 943 bytes} [Wed Aug 24 15:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:24.196689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddde643-1dcf-4445-8a29-b2d6dd9ab02b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:24.197009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddde643-1dcf-4445-8a29-b2d6dd9ab02b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:24.197279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddde643-1dcf-4445-8a29-b2d6dd9ab02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.260524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:24.280045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8ddde643-1dcf-4445-8a29-b2d6dd9ab02b None None] MFA Rules not processed for user `21dcdde810504ecf963f7b4abc93270c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:24.281258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8ddde643-1dcf-4445-8a29-b2d6dd9ab02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:24.389454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 694/1399] 10.222.0.93 () {58 vars in 1040 bytes} [Wed Aug 24 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:38:24.399260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:24.400939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:24.550437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73b1f-d990-4e33-95e1-dd48348f7d3b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:24.616033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:24.658124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:24.658760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:24.659015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:24.659291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.660941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:24.747548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:24.749255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e04c0-de2f-4af1-93a2-f62f76cdbea0 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:24.757471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 706/1400] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:38:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 15:38:24.760931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:24.761390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:24.761492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.762946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 695/1401] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:24.768167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886f21-3a6c-43a5-9e6d-6ec6064ddd12 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:24.768452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886f21-3a6c-43a5-9e6d-6ec6064ddd12 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:24.768724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886f21-3a6c-43a5-9e6d-6ec6064ddd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:24.837535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6e886f21-3a6c-43a5-9e6d-6ec6064ddd12 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:24.838645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6e886f21-3a6c-43a5-9e6d-6ec6064ddd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:24.907943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:24.958975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 707/1402] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:25.249297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:25.250818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:25.370037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:25.422704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25301-1665-49d2-8a68-a76e261f0c41 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:25.554333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:25.554949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:25.555225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:25.555497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:25.557961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:25.641600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:25.662067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:25.665149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4677-9966-4b86-8d3e-f4addfa5b10a service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:25.684322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 696/1403] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:27.634635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:27.635259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:27.635259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:27.636543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 708/1404] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:27.642254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660699f-d345-4a21-9d5e-7970d0f16780 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:27.642708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660699f-d345-4a21-9d5e-7970d0f16780 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:27.642821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660699f-d345-4a21-9d5e-7970d0f16780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:27.717266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-7660699f-d345-4a21-9d5e-7970d0f16780 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:27.718492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7660699f-d345-4a21-9d5e-7970d0f16780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:27.826368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 697/1405] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:28.114046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:28.115573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:28.284728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9edc58-aac8-4eb7-8025-8447cbfb9233 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:28.328595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:28.407198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:28.407737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:28.408111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:28.408381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:28.409997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:28.508674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:28.510348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7eff1-93df-40d9-a8b5-abd5c04d7432 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:28.541321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 709/1406] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:30.485264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:30.485828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:30.485828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:30.487459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 698/1407] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:30.492590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1259a9-bb31-4ddc-9d43-09e23bd39d9d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:30.493052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1259a9-bb31-4ddc-9d43-09e23bd39d9d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:30.493158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1259a9-bb31-4ddc-9d43-09e23bd39d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:30.554705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:30.572189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3e1259a9-bb31-4ddc-9d43-09e23bd39d9d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:30.572189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3e1259a9-bb31-4ddc-9d43-09e23bd39d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:30.692934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 710/1408] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:30.963842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:30.965542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:31.024200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:31.135138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1e70-70f9-4e04-b97d-21bb043f07ed None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:31.277140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:31.278120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:31.278394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:31.278659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:31.280294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:31.292031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:31.379683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:31.381416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad09a0-babe-4d67-a8f5-c0f4aa5441e6 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:31.421963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 699/1409] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:40.675909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=46 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:41.414787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=41 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:46.432347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e4a9-4d35-4925-8e7d-ba3bc3cee9a0 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:46.432965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e4a9-4d35-4925-8e7d-ba3bc3cee9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:46.432965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e4a9-4d35-4925-8e7d-ba3bc3cee9a0 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:46.434263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 711/1410] 10.222.0.93 () {54 vars in 918 bytes} [Wed Aug 24 15:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:46.439574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f435-1094-4801-8db0-fddd441623e6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:46.440016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f435-1094-4801-8db0-fddd441623e6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:46.440139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f435-1094-4801-8db0-fddd441623e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:46.518124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ed39f435-1094-4801-8db0-fddd441623e6 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:46.519332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ed39f435-1094-4801-8db0-fddd441623e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:46.632090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 700/1411] 10.222.0.93 () {58 vars in 1015 bytes} [Wed Aug 24 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:46.648567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dd81-c7f7-4073-9ba2-c1e6ccd96e24 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:46.648853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dd81-c7f7-4073-9ba2-c1e6ccd96e24 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:46.649153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dd81-c7f7-4073-9ba2-c1e6ccd96e24 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:46.650528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 712/1412] 10.222.0.93 () {54 vars in 918 bytes} [Wed Aug 24 15:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:46.655305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36fa27-c415-4ce8-b35b-1cc9b9265320 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:46.655579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36fa27-c415-4ce8-b35b-1cc9b9265320 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:46.655853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36fa27-c415-4ce8-b35b-1cc9b9265320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:46.738646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:46.742574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-af36fa27-c415-4ce8-b35b-1cc9b9265320 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:46.744500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-af36fa27-c415-4ce8-b35b-1cc9b9265320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:46.880630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 701/1413] 10.222.0.93 () {58 vars in 1015 bytes} [Wed Aug 24 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:38:49.270836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:49.271419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:49.271419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:49.273117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:49.278606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9c6-eb8c-4838-9767-39d78be51b44 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:49.279087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9c6-eb8c-4838-9767-39d78be51b44 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:49.279195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7a9c6-eb8c-4838-9767-39d78be51b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:49.348199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d2d7a9c6-eb8c-4838-9767-39d78be51b44 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:49.349358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d2d7a9c6-eb8c-4838-9767-39d78be51b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:49.413224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:49.459100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:49.749935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:49.751507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:49.914310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50e1f8-ce22-4257-9442-44e7e4ae5a10 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:49.991102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:50.035003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:50.035613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:50.035883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:50.036144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:50.037809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:50.129813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:50.131470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c12c7-46fe-43c1-8f43-1821bc1b3f86 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:50.150894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 714/1416] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:51.031433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:51.032041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:51.032041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:51.033365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:51.039345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1aa1-ffdb-4828-80cb-988f3d10d846 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:51.040052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1aa1-ffdb-4828-80cb-988f3d10d846 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:51.040209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1aa1-ffdb-4828-80cb-988f3d10d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:51.119893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-67ce1aa1-ffdb-4828-80cb-988f3d10d846 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:51.121161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-67ce1aa1-ffdb-4828-80cb-988f3d10d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:51.148788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:51.224935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:51.374098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:51.375523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:51.532449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7820-c5af-4987-a6aa-eada2fd28afe None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:51.575834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:51.651311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:51.651832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:51.652119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:51.652365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:51.653963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:51.750866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:51.752466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c06b67-b333-4d5b-b6b2-ccc5512b093e service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:51.771173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 704/1419] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:38:52.646952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:52.647790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:52.647790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:52.649983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:52.656419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a622c0-6dbf-4701-958f-d979c638254d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:52.657241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a622c0-6dbf-4701-958f-d979c638254d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:52.657424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a622c0-6dbf-4701-958f-d979c638254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:52.718773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:52.743758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-30a622c0-6dbf-4701-958f-d979c638254d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:52.745131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-30a622c0-6dbf-4701-958f-d979c638254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:52.876962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:53.038208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:53.040221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:53.202392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81e31-6cd4-4c42-bc5a-4ec4a197b95f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:53.214800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:53.320790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:53.321349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:53.321617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:53.321860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:53.323545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:53.430665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:53.432279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5b22b-e77e-4fb8-9321-0e9569757d00 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:53.451506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 717/1422] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:54.296271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:54.296849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:54.296849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:54.298204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:54.303390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3cdce-6d46-4f19-87d0-1b0f5c36b2f2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:54.303896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3cdce-6d46-4f19-87d0-1b0f5c36b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:54.303896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3cdce-6d46-4f19-87d0-1b0f5c36b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:54.323781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:54.383834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-08e3cdce-6d46-4f19-87d0-1b0f5c36b2f2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:54.385161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-08e3cdce-6d46-4f19-87d0-1b0f5c36b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:54.486817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:54.633686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:54.636717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:54.759704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:54.799142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0915f8-bb19-4ebe-b074-a9f23028d723 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:54.923493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:54.923997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:54.924254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:54.924542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:54.926164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:55.006684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:55.022117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:55.023724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed8853-dc34-40ad-a106-b35bc5b02409 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:55.041579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 707/1425] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:55.942315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:55.942931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:55.942931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:55.944212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:55.952535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cc7e-b139-4460-a54b-f19923fde68c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:55.953019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cc7e-b139-4460-a54b-f19923fde68c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:55.953128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6cc7e-b139-4460-a54b-f19923fde68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:56.038834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-18d6cc7e-b139-4460-a54b-f19923fde68c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:56.040048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-18d6cc7e-b139-4460-a54b-f19923fde68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:56.144745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:56.300960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:56.302539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:56.400468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:56.467753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22caa02-419b-45fa-b30e-36e90af7e652 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:56.582738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:56.583368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:56.583648 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:56.583913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:56.585535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:56.644437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:56.690287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:56.691908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a6b31-7591-4b01-b170-4ca271d53d8c service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:56.710096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 720/1428] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:57.510704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:57.511629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:57.511629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:57.513687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:57.522092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fff4f1-30e7-4a5e-9656-41fd29190656 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:57.522533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fff4f1-30e7-4a5e-9656-41fd29190656 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:57.522633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fff4f1-30e7-4a5e-9656-41fd29190656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:57.607881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-86fff4f1-30e7-4a5e-9656-41fd29190656 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:57.609192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-86fff4f1-30e7-4a5e-9656-41fd29190656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:57.715218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:57.866964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:57.869329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:57.930732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:58.030813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb83bc-98f8-4e2a-b645-68d57cd5b947 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:58.160495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:58.161450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:58.161796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:58.162191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:58.164770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:58.175902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:58.265149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:58.266782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7ed0-ec3d-4f21-821d-7b62593b0ca9 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:58.286510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 710/1431] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:38:59.088833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:59.089839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:59.089839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:59.091775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:38:59.097903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64b1e-abe4-4b97-abbd-5f843ff8e331 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:59.098613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64b1e-abe4-4b97-abbd-5f843ff8e331 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:59.098777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64b1e-abe4-4b97-abbd-5f843ff8e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:59.183758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-43e64b1e-abe4-4b97-abbd-5f843ff8e331 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:38:59.184965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-43e64b1e-abe4-4b97-abbd-5f843ff8e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:59.258357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:59.287128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:38:59.437107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:38:59.438490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:59.462571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:59.602672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d7e69-079a-4842-a7fb-3e458857767c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:38:59.705409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:59.731717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:38:59.732324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:38:59.732597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:38:59.732864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:38:59.734493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:38:59.824581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:38:59.827194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c208b-a1d6-45aa-b8a1-682ad2801cd6 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:38:59.856032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 723/1434] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:00.659144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:00.659746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:00.659746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:00.661163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:00.667219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5460-901f-4984-b3e4-ba227cd13168 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:00.667868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5460-901f-4984-b3e4-ba227cd13168 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:00.668073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5460-901f-4984-b3e4-ba227cd13168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:00.765981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b55e5460-901f-4984-b3e4-ba227cd13168 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:00.767184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b55e5460-901f-4984-b3e4-ba227cd13168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:00.811792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:00.874882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:01.040036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:01.041624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:01.211450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2939dd6-002e-49e3-ae10-e5fc9aa12f49 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:01.268728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:01.328800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:01.329437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:01.329705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:01.329969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:01.331524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:01.433886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:01.435505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64decb-0967-4b8b-87a7-184e5144cd2b service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:01.455570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 713/1437] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:02.263727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:02.264677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:02.264677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:02.266819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:02.272326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b753-2475-4b26-9759-d1d8a011cb3c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:02.272775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b753-2475-4b26-9759-d1d8a011cb3c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:02.272890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b753-2475-4b26-9759-d1d8a011cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:02.352956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2741b753-2475-4b26-9759-d1d8a011cb3c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:02.354212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2741b753-2475-4b26-9759-d1d8a011cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:02.356256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:02.453234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:02.603606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:02.605904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:02.760911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f6e62-67ce-46db-84f2-d731ea02ae42 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:02.788448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:02.878877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:02.879489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:02.879766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:02.880032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:02.881737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:02.971918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:02.973570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5aa1c-ebed-4752-a809-089714fea2a8 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:02.991731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 726/1440] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:04.785128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720807-5e74-4f0d-aea0-01017471869a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:04.785730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720807-5e74-4f0d-aea0-01017471869a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:04.785841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720807-5e74-4f0d-aea0-01017471869a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:04.787217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:04.793826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da355b-4623-4f84-b1c8-a5fc635c1ed7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:04.794581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da355b-4623-4f84-b1c8-a5fc635c1ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:04.794772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da355b-4623-4f84-b1c8-a5fc635c1ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:04.843170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:04.871329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-71da355b-4623-4f84-b1c8-a5fc635c1ed7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:04.872544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-71da355b-4623-4f84-b1c8-a5fc635c1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:04.985707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:05.272145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720807-5e74-4f0d-aea0-01017471869a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:05.274648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-09720807-5e74-4f0d-aea0-01017471869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:05.398042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720807-5e74-4f0d-aea0-01017471869a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:05.430097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:05.473252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:05.473768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:05.474038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:05.474300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:05.475887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:05.594434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:05.595873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29164442-8f9a-47a3-9052-f94fcb7763b4 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:05.614554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 716/1443] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:07.677303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:07.677882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:07.677882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:07.679203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:07.685984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f7a5d-61a8-44f2-8bd3-9bd88c4a6701 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:07.686431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f7a5d-61a8-44f2-8bd3-9bd88c4a6701 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:07.686533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f7a5d-61a8-44f2-8bd3-9bd88c4a6701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:07.769636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b69f7a5d-61a8-44f2-8bd3-9bd88c4a6701 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:07.771947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b69f7a5d-61a8-44f2-8bd3-9bd88c4a6701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:07.787368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:07.876343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:08.166646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:08.168188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:08.275414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b70d-26c7-4145-8a9c-09a29166e0c0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:08.287868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:08.351663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:08.352277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:08.352558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:08.352802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:08.354550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:08.470931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:08.472389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa43254-e23b-4901-9c74-b289fcd8b757 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:08.491386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 729/1446] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:10.711016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:10.711618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:10.711618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:10.712929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:10.718661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569909-5d78-4310-b4b6-4add10fe4132 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:10.719094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569909-5d78-4310-b4b6-4add10fe4132 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:10.719184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569909-5d78-4310-b4b6-4add10fe4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:10.776870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:10.803289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d2569909-5d78-4310-b4b6-4add10fe4132 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:10.805164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d2569909-5d78-4310-b4b6-4add10fe4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:10.904853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:11.206631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:11.208171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:11.326329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee441-35f2-437b-a2f2-69ab0dee824f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:11.373002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:11.410249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:11.410856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:11.411131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:11.411423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:11.413011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:11.527042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:11.528479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2c38-4099-4a75-bc66-792e422a135b service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:11.553721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 719/1449] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:39:13.548358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0889-e15d-41ef-a848-da161278736e None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:13.549284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0889-e15d-41ef-a848-da161278736e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:13.549284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0889-e15d-41ef-a848-da161278736e None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:13.551466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:13.560359 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391421a-feb5-4cd1-a153-2cce66170576 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:13.560781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391421a-feb5-4cd1-a153-2cce66170576 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:13.560948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391421a-feb5-4cd1-a153-2cce66170576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:13.640856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f391421a-feb5-4cd1-a153-2cce66170576 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:13.642106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f391421a-feb5-4cd1-a153-2cce66170576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:13.664191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:13.745718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:14.033846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b0889-e15d-41ef-a848-da161278736e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:14.035531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d63b0889-e15d-41ef-a848-da161278736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:14.155880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b0889-e15d-41ef-a848-da161278736e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:14.182793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:14.240449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:14.241090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:14.241366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:14.241635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:14.243232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:14.375644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:14.377022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fada8-5d52-4707-b4f6-3d15e9079108 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:14.395276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 732/1452] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:16.319268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:16.320164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:16.320164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:16.322264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:16.328032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757087a-5365-4055-a417-4eeb97b0b41e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:16.328499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757087a-5365-4055-a417-4eeb97b0b41e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:16.328610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757087a-5365-4055-a417-4eeb97b0b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:16.394018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:16.397249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5757087a-5365-4055-a417-4eeb97b0b41e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:16.399061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5757087a-5365-4055-a417-4eeb97b0b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:16.501863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:39:16.786344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:16.787888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:16.898836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98d337-4161-476a-9e8d-1972e0997cb2 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:16.952858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:16.979919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:16.980550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:16.980824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:16.981119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:16.982738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:17.098233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:17.099571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca0c5-c6f5-4e0b-87d3-196689a712d5 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:17.118275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 722/1455] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:39:19.059802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:19.060472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:19.060472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:19.061760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:19.068279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c58c-fa8d-48fb-91c3-dca184a8da37 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:19.068743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c58c-fa8d-48fb-91c3-dca184a8da37 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:19.068855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c58c-fa8d-48fb-91c3-dca184a8da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:19.149642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-de35c58c-fa8d-48fb-91c3-dca184a8da37 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:19.150900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-de35c58c-fa8d-48fb-91c3-dca184a8da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:19.182973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:19.252802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:19.536746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:19.539253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:19.655394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3db6a-26ae-4c1b-b711-48d0e86cecde None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:19.685080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:19.733048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:19.733665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:19.733934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:19.734196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:19.735776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:19.849197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:19.850572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d89aa-2c5d-4bce-86c0-a6a1dc233c81 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:19.869209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 735/1458] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:21.891421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:21.892025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:21.892025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:21.893349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:21.900147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3c50-724c-42a5-8e9d-223a6db5ba76 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:21.900879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3c50-724c-42a5-8e9d-223a6db5ba76 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:21.901084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad3c50-724c-42a5-8e9d-223a6db5ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:21.978563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-01ad3c50-724c-42a5-8e9d-223a6db5ba76 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:21.979785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-01ad3c50-724c-42a5-8e9d-223a6db5ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:21.988662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:22.085338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:22.365496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:22.367992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:22.483371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f4250-301c-41cd-8647-49133006e08a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:22.542165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:22.561519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:22.562127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:22.562398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:22.562663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:22.564245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:22.678769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:22.680211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6322fe8-d739-4fc6-b82e-7114afaa1813 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:22.698770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 725/1461] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:24.629210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:24.629819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:24.629819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:24.631096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:24.636932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086438c-ccec-4a8c-b0fa-764fe1916d5e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:24.637385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086438c-ccec-4a8c-b0fa-764fe1916d5e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:24.637499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086438c-ccec-4a8c-b0fa-764fe1916d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:24.710143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2086438c-ccec-4a8c-b0fa-764fe1916d5e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:24.711349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2086438c-ccec-4a8c-b0fa-764fe1916d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:24.752136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:24.817879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:25.096874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:25.098456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:25.219931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08017b8d-c1fd-48d2-addc-1a50993d93ac None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:25.262026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:25.303415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:25.304027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:25.304303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:25.304570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:25.306335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:25.426400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:25.427765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690759-8990-4d69-b947-79a9065dda2b service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:25.449320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 738/1464] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:27.375330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:27.376254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:27.376254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:27.378442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:27.384207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4897-5f9e-4dd5-b5cd-c3c3edf14b0c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:27.384675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4897-5f9e-4dd5-b5cd-c3c3edf14b0c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:27.384784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4897-5f9e-4dd5-b5cd-c3c3edf14b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:27.457765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-62bf4897-5f9e-4dd5-b5cd-c3c3edf14b0c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:27.458991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-62bf4897-5f9e-4dd5-b5cd-c3c3edf14b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:27.477817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:27.557812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:27.843536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:27.845224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:27.979213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42394f17-1124-4e04-8192-66e64379cd30 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:28.052872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:28.060484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:28.061133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:28.061408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:28.061676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:28.063396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:28.190844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:28.192318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fd8c0-1d2f-470a-bdbe-0537f0dcd897 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:28.211387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 728/1467] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:30.107647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:30.108566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:30.108566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:30.109854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:30.115779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4ccc-25f0-44c9-917a-ca6a969fe05c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:30.116264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4ccc-25f0-44c9-917a-ca6a969fe05c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:30.116401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e4ccc-25f0-44c9-917a-ca6a969fe05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:30.187078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-7f9e4ccc-25f0-44c9-917a-ca6a969fe05c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:30.188295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7f9e4ccc-25f0-44c9-917a-ca6a969fe05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:30.237975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:30.285889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:30.570229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:30.572748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:30.695260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0727-dffc-4f5f-849e-d142e2b1bf3a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:30.754659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:30.783224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:30.783841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:30.784118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:30.784391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:30.786121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:30.900863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:30.902344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a56d-263d-4fd1-ae9f-17775af7e5e7 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:30.921462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 741/1470] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:40.284094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=22 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:40.918906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=66 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:50.952255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393007-0720-4b66-92c5-f175001b9c20 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:50.952822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393007-0720-4b66-92c5-f175001b9c20 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:50.952822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e393007-0720-4b66-92c5-f175001b9c20 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:50.954928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 730/1471] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:50.964177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4216-2699-4a8f-ae1d-90e1cd74bed1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:50.964606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4216-2699-4a8f-ae1d-90e1cd74bed1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:50.965095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4216-2699-4a8f-ae1d-90e1cd74bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:51.046534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cffa4216-2699-4a8f-ae1d-90e1cd74bed1 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:51.047744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cffa4216-2699-4a8f-ae1d-90e1cd74bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:51.163719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 742/1472] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:51.461034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:51.461314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:51.461611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:51.462957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 731/1473] 10.222.0.93 () {54 vars in 967 bytes} [Wed Aug 24 15:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:51.469585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e910-6ad6-47f4-8b12-f677c86391e0 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:51.469868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e910-6ad6-47f4-8b12-f677c86391e0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:51.470136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e910-6ad6-47f4-8b12-f677c86391e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:51.549097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f753e910-6ad6-47f4-8b12-f677c86391e0 None None] MFA Rules not processed for user `284f6ac815d940ccb5f3dc7755bc201e`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:51.550290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f753e910-6ad6-47f4-8b12-f677c86391e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:51.572340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:51.630329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 743/1474] 10.222.0.93 () {58 vars in 1064 bytes} [Wed Aug 24 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:51.639452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:51.642001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:51.765869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f446c1-417b-4926-8b1d-9ba356d6393a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:51.855246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:51.855764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:51.856036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:51.856306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:51.857937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:51.917232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:51.985398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:51.987268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d20f5-fccd-43ae-8bde-f8b70e5b9da3 service glance] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:52.010067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 732/1475] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:53.980510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:53.981504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:53.981504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:53.983584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 744/1476] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:53.989099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ed69-27b7-412f-a373-9e63cf1c0412 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:53.989555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ed69-27b7-412f-a373-9e63cf1c0412 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:53.989652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ed69-27b7-412f-a373-9e63cf1c0412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:54.057850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1724ed69-27b7-412f-a373-9e63cf1c0412 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:54.059061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1724ed69-27b7-412f-a373-9e63cf1c0412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:54.158792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 733/1477] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:54.425860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:54.428277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:54.562924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68210-d02c-4133-9bd8-cfefcd0ffe95 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:54.617426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:54.785758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:54.786568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:54.786909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:54.787284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:54.788232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:54.790286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:39:54.790286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:39:54.790286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:39:54.791437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed8a2f-0f5c-45f8-b68f-8814e1d23040 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:54.810532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 745/1478] 10.222.0.93 () {56 vars in 1108 bytes} [Wed Aug 24 15:39:54 2022] GET /identity/v3/projects => generated 2553 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:39:56.716049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:56.717028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:56.717028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:56.719087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 734/1479] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:39:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:56.727946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303fab-0fb7-43ef-8c0b-d9750370236d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:56.728395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303fab-0fb7-43ef-8c0b-d9750370236d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:56.728493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303fab-0fb7-43ef-8c0b-d9750370236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:56.806678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-96303fab-0fb7-43ef-8c0b-d9750370236d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:56.807891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-96303fab-0fb7-43ef-8c0b-d9750370236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:56.911603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 746/1480] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:39:57.211071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:39:57.212651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:57.222983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:57.367211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea34d1-76d6-4884-8c6c-8a257b6177ce None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:39:57.463090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:57.498571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:39:57.499178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:57.499452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:57.499720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:57.501344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:57.592947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:39:57.594593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d606c-7a54-446f-a80b-b645cb10b4aa service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:39:57.613443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 735/1481] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:39:59.698299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:59.698971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:59.698971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:59.700187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 747/1482] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:39:59.705762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f24f0-2b90-4d09-85f1-ad08d099835a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:39:59.706237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f24f0-2b90-4d09-85f1-ad08d099835a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:39:59.706351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f24f0-2b90-4d09-85f1-ad08d099835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:39:59.783375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-124f24f0-2b90-4d09-85f1-ad08d099835a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:39:59.784588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-124f24f0-2b90-4d09-85f1-ad08d099835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:39:59.836676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:59.889445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 736/1483] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:40:00.179891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:40:00.181441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:00.207818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:00.289593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0b70-0ac0-405f-9927-7dc9db7df3e5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:40:00.378831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:40:00.379375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:00.379624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:00.379920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:00.381555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:00.463557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:00.509365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:40:00.510821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c324c3d-a2dd-4e15-a250-948439dcf871 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:40:00.531402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 748/1484] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:02.474723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:02.475273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:02.475273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:02.476543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 737/1485] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:40:02.482727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6ebb-b6cd-4124-a522-67b48097bb12 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:02.483485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6ebb-b6cd-4124-a522-67b48097bb12 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:02.483637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6ebb-b6cd-4124-a522-67b48097bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:02.556084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-861d6ebb-b6cd-4124-a522-67b48097bb12 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:40:02.557315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-861d6ebb-b6cd-4124-a522-67b48097bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:02.659608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 749/1486] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:40:02.948251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:40:02.949851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:03.065357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbaf3f-d37e-463c-8264-b4eb791809a9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:40:03.143073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:03.145263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:40:03.145942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:03.146199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:03.146502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:03.148613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:03.260282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:40:03.261768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217848-0b6b-4c98-9e77-798b87fe93c9 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:40:03.279933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 738/1487] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:05.308174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:05.309111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:05.309111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:05.311251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 750/1488] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:40:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:40:05.316932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca24ef-476d-4cfe-bbf5-c5e27c4cde50 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:05.317411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca24ef-476d-4cfe-bbf5-c5e27c4cde50 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:05.317505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca24ef-476d-4cfe-bbf5-c5e27c4cde50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:05.384947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b1ca24ef-476d-4cfe-bbf5-c5e27c4cde50 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:40:05.386159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b1ca24ef-476d-4cfe-bbf5-c5e27c4cde50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:05.443384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:05.490453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 739/1489] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:40:05.775180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:40:05.777656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:05.828003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:05.903438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4569c6f-3ae4-4526-839a-db65a4dc4c21 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:40:05.986536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:40:05.987135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:05.987475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:05.987740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:05.989356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:06.079238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:06.110868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:40:06.112363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed0d53-f396-414f-93a3-b0ac9295c129 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:40:06.131671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 751/1490] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:08.210184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:08.210712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:08.210822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:08.212089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 740/1491] 10.222.0.93 () {54 vars in 927 bytes} [Wed Aug 24 15:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:40:08.217713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e9ac-8ff2-4f4b-95d5-c357e319bf10 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:08.218128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e9ac-8ff2-4f4b-95d5-c357e319bf10 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:08.218277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e9ac-8ff2-4f4b-95d5-c357e319bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:08.299005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-50b1e9ac-8ff2-4f4b-95d5-c357e319bf10 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:40:08.300195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-50b1e9ac-8ff2-4f4b-95d5-c357e319bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:08.400186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 752/1492] 10.222.0.93 () {58 vars in 1024 bytes} [Wed Aug 24 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:40:08.681883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:40:08.683416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:08.803453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbd30f-7c16-490d-85ee-78ea5788b70e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:40:08.875881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:40:08.876482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:40:08.876757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:40:08.877065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:40:08.878743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:40:08.888093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:09.000927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:40:09.002356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfc00-398a-4b7e-93a6-4f86f1c0ad0e service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:40:09.021268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 741/1493] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:40:18.398238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=82 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:19.018545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=50 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:20.405780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:20.406715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:20.406715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:20.485622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:41:20.486836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:20.587729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 753/1494] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:41:20.597123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:20.597673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:20.597673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:20.682839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:41:20.683954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:20.799064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 742/1495] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:41:20.804924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:20.806156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:20.818598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254dd11-dff7-44c0-85ef-0469069a8973 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:20.891784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:20.931954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:20.932558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:20.932824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:20.933187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:20.933760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:41:20.934056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:20.935059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:20.935059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:41:20.935059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:41:20.935944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:20.947597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 754/1496] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:41:20.956508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:20.966203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dd3f7-8a3d-40a2-8789-61d4de4ae956 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:21.034195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:21.069028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:21.069632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.069903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.070164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.070778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:21.072567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:21.072567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:41:21.072567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:41:21.073808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:21.137934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 743/1497] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:41:20 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:41:21.142301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:21.144210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:21.177235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6c65-41f8-479d-b8cd-0480bf8807c1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:21.274986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:21.275602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.275873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.276136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.276775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:21.277798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:21.277798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:41:21.277798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:41:21.279053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:21.337724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 755/1498] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:41:21 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:41:21.342063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:21.343591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:21.408798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe593f-76b6-4d45-b4c9-82e43f9e0aeb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:21.494234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:21.505479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:21.506140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.506370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.506634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.507276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:21.508314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:21.508314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:41:21.508314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:41:21.509248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:21.522129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 744/1499] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:41:21.526581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:21.528862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:21.545986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b335a-2022-4fc8-ae0e-d281baaaad1a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:21.574064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:21.646691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:21.647303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.647570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.647834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.648461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:21.649499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:21.649499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:41:21.649499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:41:21.650387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1779f6-acf9-47ba-8b70-29feda902e59 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:21.662675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 756/1500] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:41:21.667057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:21.668571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:21.702623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431d15b-b3d1-48f0-a177-d6d23e79314a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:21.807614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:21.808190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.808457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.808723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] PATH_INFO: `/v3/projects/e9c31e5184134e33be7f519f0e8682e9/users/4e07632e100b415bad30c01bffd2b698/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.834309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c31e5184134e33be7f519f0e8682e9, user_id=4e07632e100b415bad30c01bffd2b698, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:21.835333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:21.835333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:41:21.835333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:41:21.837333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830daa9-678e-4e71-a03f-836e57f189a3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:21.863439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 745/1501] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:41:21 2022] PUT /identity/v3/projects/e9c31e5184134e33be7f519f0e8682e9/users/4e07632e100b415bad30c01bffd2b698/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:41:21.876144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dadc4-9928-4c38-9e8c-2bd005316cda None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:21.876506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dadc4-9928-4c38-9e8c-2bd005316cda None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:21.876813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dadc4-9928-4c38-9e8c-2bd005316cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:21.937700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-7c5dadc4-9928-4c38-9e8c-2bd005316cda None None] MFA Rules not processed for user `4e07632e100b415bad30c01bffd2b698`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:41:21.938896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7c5dadc4-9928-4c38-9e8c-2bd005316cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:22.035443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 757/1502] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:41:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:41:22.049034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:22.049318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:22.049586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:22.051024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 746/1503] 10.222.0.93 () {54 vars in 964 bytes} [Wed Aug 24 15:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:41:22.055864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ad70-1a11-42f3-b38d-beb4d7e4c473 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:22.056157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ad70-1a11-42f3-b38d-beb4d7e4c473 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:22.056419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ad70-1a11-42f3-b38d-beb4d7e4c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:22.088846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:22.135124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6921ad70-1a11-42f3-b38d-beb4d7e4c473 None None] MFA Rules not processed for user `8620b3bc47e241b18a60bd7f43fd4f57`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:41:22.136353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6921ad70-1a11-42f3-b38d-beb4d7e4c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:22.216732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 758/1504] 10.222.0.93 () {58 vars in 1061 bytes} [Wed Aug 24 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:41:22.224701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:22.226256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:22.280447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:22.459719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab5e61-aa80-4c11-a8e3-602b019651ae None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:22.542164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:22.542803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:22.543073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:22.543317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:22.544925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:22.648135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:22.649579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:22.653028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:22.668087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 747/1505] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:41:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:41:22.715471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c756-ca1f-4ae4-8051-1fc898b50019 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:22.715921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c756-ca1f-4ae4-8051-1fc898b50019 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:22.716018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c756-ca1f-4ae4-8051-1fc898b50019 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:22.717318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 759/1506] 10.222.0.93 () {52 vars in 830 bytes} [Wed Aug 24 15:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:41:22.721101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:22.722315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:22.836424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5640-0957-4522-b777-ad0492c06891 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:22.930405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:22.931030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:22.931305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:22.931575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] PATH_INFO: `/v3/users/4e07632e100b415bad30c01bffd2b698` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:22.944679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e07632e100b415bad30c01bffd2b698)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:22.945736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:22.945736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:41:22.945736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:41:22.946953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:22.956796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:23.014704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e07632e100b415bad30c01bffd2b698'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:23.015131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e07632e100b415bad30c01bffd2b698'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:23.015656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e07632e100b415bad30c01bffd2b698'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:23.039047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e07632e100b415bad30c01bffd2b698'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:23.051092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e07632e100b415bad30c01bffd2b698'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:23.070456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 748/1507] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:41:22 2022] DELETE /identity/v3/users/4e07632e100b415bad30c01bffd2b698 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:41:23.076928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:23.077348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:23.077689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:23.142317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:41:23.143874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:23.234882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:23.252275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 760/1508] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:41:23.262544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:23.263813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:23.368204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5397545-fc31-4285-a5fa-1a7461297a69 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:23.430558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:23.457912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:23.458529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:23.458813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:23.459076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:23.460675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:23.588548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:23.590063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2e444-cd51-4dab-812c-7e4b350d37b1 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:23.614465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 749/1509] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:41:23.949770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:41:23.951097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:41:23.963076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199fed3-e63f-4f2a-9341-2748f4e9d8e5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:41:24.066596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:41:24.067240 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:41:24.067512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:41:24.067881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] PATH_INFO: `/v3/projects/e9c31e5184134e33be7f519f0e8682e9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:41:24.078658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c31e5184134e33be7f519f0e8682e9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:41:24.079674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:41:24.079674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:41:24.079674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:41:24.081029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:41:24.155765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c31e5184134e33be7f519f0e8682e9', 'request_id': 'req-95048a11-ce06-4709-b254-03f2b28fa4f7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:24.167736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c31e5184134e33be7f519f0e8682e9', 'request_id': 'req-95048a11-ce06-4709-b254-03f2b28fa4f7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:24.182661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c31e5184134e33be7f519f0e8682e9', 'request_id': 'req-95048a11-ce06-4709-b254-03f2b28fa4f7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:24.206213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] The token cache is being invalidate because project e9c31e5184134e33be7f519f0e8682e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:41:24.206434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:24.207023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-95048a11-ce06-4709-b254-03f2b28fa4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:41:24.208372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 761/1510] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:41:23 2022] DELETE /identity/v3/projects/e9c31e5184134e33be7f519f0e8682e9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:41:33.611195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=62 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:41:34.204079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:03.333733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:03.334362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:03.334362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:03.336309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:43:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:03.344471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262ee0-42c3-477e-9756-ffa25052599f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:03.344945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262ee0-42c3-477e-9756-ffa25052599f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:03.345163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262ee0-42c3-477e-9756-ffa25052599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:03.451335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5c262ee0-42c3-477e-9756-ffa25052599f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:03.452559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5c262ee0-42c3-477e-9756-ffa25052599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:03.563716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:03.720751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:03.723132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:03.853984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291f47c-a711-46c1-8f13-4105fa46e6e7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:03.863126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:03.863733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:03.864004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:03.864270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:03.872718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:03.874457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44b672-5513-49f4-8cdd-b7a339a4ac1e service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:03.885133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 751/1513] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:04.705273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2381cb-97ca-4fa3-aa6d-6c67d4ae158a None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.706127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2381cb-97ca-4fa3-aa6d-6c67d4ae158a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.706127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2381cb-97ca-4fa3-aa6d-6c67d4ae158a None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.707574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:04.712549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8ff1-eedc-4b95-8324-5827df02bc71 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.713016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8ff1-eedc-4b95-8324-5827df02bc71 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.713121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8ff1-eedc-4b95-8324-5827df02bc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.733427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-52ef8ff1-eedc-4b95-8324-5827df02bc71 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:04.734620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-52ef8ff1-eedc-4b95-8324-5827df02bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:04.743243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:04.895730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2381cb-97ca-4fa3-aa6d-6c67d4ae158a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:04.920628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2381cb-97ca-4fa3-aa6d-6c67d4ae158a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:04.929004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:04.929605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:04.929882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:04.930154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:04.938545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:04.940163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf8478-a77a-41ed-a2be-543b8cc0c7d5 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:04.950191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 764/1516] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:05.672354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c73a7-4865-43d3-ab80-56f494f0c3a8 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.672644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c73a7-4865-43d3-ab80-56f494f0c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.672882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c73a7-4865-43d3-ab80-56f494f0c3a8 None None] PATH_INFO: `/v3` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.674402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 753/1517] 10.222.0.99 () {54 vars in 925 bytes} [Wed Aug 24 15:43:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:43:05.681960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9852-9d7b-46cd-8974-3a492cbd5abf None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:05.682412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9852-9d7b-46cd-8974-3a492cbd5abf None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:05.682849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9852-9d7b-46cd-8974-3a492cbd5abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:05.758565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-71eb9852-9d7b-46cd-8974-3a492cbd5abf None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:05.759786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-71eb9852-9d7b-46cd-8974-3a492cbd5abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:05.778981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:05.840436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 765/1518] 10.222.0.99 () {58 vars in 1015 bytes} [Wed Aug 24 15:43:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:09.841841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f76a-232e-44ab-96ce-652d51353b53 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.842357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f76a-232e-44ab-96ce-652d51353b53 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.842357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f76a-232e-44ab-96ce-652d51353b53 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.843604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 754/1519] 10.222.0.93 () {54 vars in 961 bytes} [Wed Aug 24 15:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:09.849048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e829ce-1532-40c3-aaff-bd5293f09540 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.849466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e829ce-1532-40c3-aaff-bd5293f09540 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.849664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e829ce-1532-40c3-aaff-bd5293f09540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.869674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-40e829ce-1532-40c3-aaff-bd5293f09540 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:09.870851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-40e829ce-1532-40c3-aaff-bd5293f09540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:09.879875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 766/1520] 10.222.0.93 () {58 vars in 1058 bytes} [Wed Aug 24 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:43:09.887513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f76a-232e-44ab-96ce-652d51353b53 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:09.907385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f76a-232e-44ab-96ce-652d51353b53 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:09.913216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:09.913816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:09.914084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:09.914361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:09.923302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:09.925081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d294-16cd-44f2-becb-56464862d58c service placement] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:09.934847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 755/1521] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:16.187853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1205-cc11-4d85-aea7-4f3966536e3f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.188479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1205-cc11-4d85-aea7-4f3966536e3f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.188479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1205-cc11-4d85-aea7-4f3966536e3f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.189818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:16.195731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720edb-d3d6-4dfd-9617-c619a29a1ae6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.196490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720edb-d3d6-4dfd-9617-c619a29a1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.196587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720edb-d3d6-4dfd-9617-c619a29a1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.220451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-89720edb-d3d6-4dfd-9617-c619a29a1ae6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:16.221711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-89720edb-d3d6-4dfd-9617-c619a29a1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:16.230852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:16.388124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1205-cc11-4d85-aea7-4f3966536e3f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:16.404661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1205-cc11-4d85-aea7-4f3966536e3f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:16.410696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:16.411292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:16.411569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:16.411840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:16.420100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:16.421756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2bae2-1cb4-4c6a-8ad1-5e2eb34e53c9 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:16.431282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 768/1524] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:17.240165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d5f5-0167-47b0-b3cf-138a0be14d8f None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.240942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d5f5-0167-47b0-b3cf-138a0be14d8f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.241092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d5f5-0167-47b0-b3cf-138a0be14d8f None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.243092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 15:43:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:17.250892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591524d0-100f-43bd-9201-c429b197fdca None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.251355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591524d0-100f-43bd-9201-c429b197fdca None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.251471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591524d0-100f-43bd-9201-c429b197fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.272324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-591524d0-100f-43bd-9201-c429b197fdca None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:17.273555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-591524d0-100f-43bd-9201-c429b197fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:17.281996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:17.435365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12d5f5-0167-47b0-b3cf-138a0be14d8f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:17.458783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12d5f5-0167-47b0-b3cf-138a0be14d8f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:17.465159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:17.465790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:17.466051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:17.466319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:17.474921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:17.476432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5a360-4fa4-42d9-9fad-9bf4e5f3fec0 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:17.486426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 758/1527] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:21.293568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.294160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.294160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.295482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:21.301762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666d6e-f714-4cc4-948a-7e5845ad1c0f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.302477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666d6e-f714-4cc4-948a-7e5845ad1c0f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.302606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666d6e-f714-4cc4-948a-7e5845ad1c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.332867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9d666d6e-f714-4cc4-948a-7e5845ad1c0f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:21.334109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9d666d6e-f714-4cc4-948a-7e5845ad1c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:21.342722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:21.629335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:21.632186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:21.724151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d415-ac3b-473f-9c5c-d36ab8d10ce1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:21.728094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:21.728705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:21.729001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:21.729276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:21.740151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:21.741654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d09c-8f0d-4b08-8592-b1882acf4c9f service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:21.752431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 771/1530] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:23.638086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c6ff-504f-45be-99a4-a1929d836c93 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.638678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c6ff-504f-45be-99a4-a1929d836c93 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.638678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c6ff-504f-45be-99a4-a1929d836c93 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.640671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:23.646434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855a275-f473-4cb8-856e-c9257d80f6da None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.646914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855a275-f473-4cb8-856e-c9257d80f6da None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.647020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855a275-f473-4cb8-856e-c9257d80f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.667984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a855a275-f473-4cb8-856e-c9257d80f6da None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:23.669372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a855a275-f473-4cb8-856e-c9257d80f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:23.677752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:23.961367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c6ff-504f-45be-99a4-a1929d836c93 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:23.977308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c6ff-504f-45be-99a4-a1929d836c93 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:23.981416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:23.982009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:23.982279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:23.982547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:23.991920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:23.993403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9389d-eff5-4f80-bf53-eb6229ddb57f service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:24.003357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 761/1533] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:27.432502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.433105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.433105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.435144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:27.443630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a312d-700e-4a2d-bd6d-5e1e9c80cff8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:27.444040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a312d-700e-4a2d-bd6d-5e1e9c80cff8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:27.444193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a312d-700e-4a2d-bd6d-5e1e9c80cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:27.468134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-377a312d-700e-4a2d-bd6d-5e1e9c80cff8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:27.469377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-377a312d-700e-4a2d-bd6d-5e1e9c80cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:27.478173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:28.021363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:28.023477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:28.100356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:28.118759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa3c61-cb99-45c1-a2aa-75ecb01d67bc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:28.122441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:28.123052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:28.123357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:28.123627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:28.132792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:28.134264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882c2b3-e4a2-46ce-bec4-3205d34cd1d9 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:28.144001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 774/1536] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:30.036628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.037249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.037249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.039262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 15:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:43:30.047903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cd337-9aef-476b-8b79-dbbcd85f2198 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.048319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cd337-9aef-476b-8b79-dbbcd85f2198 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.048495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cd337-9aef-476b-8b79-dbbcd85f2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.074964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-dd6cd337-9aef-476b-8b79-dbbcd85f2198 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:43:30.076145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dd6cd337-9aef-476b-8b79-dbbcd85f2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:30.085423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:43:30.628461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:43:30.631484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:43:30.655191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee0e53-1647-41f7-9c60-b68fddf51578 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:43:30.660784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:43:30.661407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:43:30.661676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:43:30.661941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:43:30.671223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:43:30.672649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b14e5a-f215-4f1d-9bda-507a44911cc7 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:43:30.682140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 764/1539] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:43:40.070052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=11 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:40.678048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:59.014131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c555a-20e0-4b57-b523-e43fdbc9f831 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.015399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c555a-20e0-4b57-b523-e43fdbc9f831 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.015399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c555a-20e0-4b57-b523-e43fdbc9f831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.044024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-103c555a-20e0-4b57-b523-e43fdbc9f831 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.045359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-103c555a-20e0-4b57-b523-e43fdbc9f831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.058669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 776/1540] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.067844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.068473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.068473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.073023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355aa-c54c-4307-9cf3-4f06d2541c6b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.073376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355aa-c54c-4307-9cf3-4f06d2541c6b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.073577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b355aa-c54c-4307-9cf3-4f06d2541c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.097913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.099117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.102059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d4b355aa-c54c-4307-9cf3-4f06d2541c6b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.103241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d4b355aa-c54c-4307-9cf3-4f06d2541c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.119089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 777/1541] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 15:44:59.127974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 765/1542] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.128845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.129156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.129430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.132431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.143097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bccf88-6e8a-4033-8f70-6b83caaf4932 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.160782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.161899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.162179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.162448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.162932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.163249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.163549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.164166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.164572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:59.164572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:44:59.164572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:44:59.165531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.181999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 778/1543] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.184870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 766/1544] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:44:59.187112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.195579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.201973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c856-dcc8-462e-bf7c-6b8784f1d8cc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.214051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.214718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.214989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.215417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.216096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.216399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.218374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.231214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6bd5-1239-4bd3-81fd-79781cc6d730 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.245106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.246264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.247202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.247477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 779/1545] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.247953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.248826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.252148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145860e-4365-456c-a295-0794efcc8746 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.256439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.275832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b0e36-ae39-4bd0-bafd-e2bfa50c837d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.285824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.286732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.287238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.287525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.288318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.292548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:59.292548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:44:59.292548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:44:59.292548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e563e-8a0e-408d-996f-60fdf775573b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.318525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 767/1546] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:44:59.320297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.320789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.321374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.345729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.347478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.356599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 780/1547] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:59.360444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309cb09-39fd-43dd-b2f8-2ba05cb982ea None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.360607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309cb09-39fd-43dd-b2f8-2ba05cb982ea None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.361930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309cb09-39fd-43dd-b2f8-2ba05cb982ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.401543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d309cb09-39fd-43dd-b2f8-2ba05cb982ea None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.402914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d309cb09-39fd-43dd-b2f8-2ba05cb982ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.440786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 768/1548] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.441944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.453284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0653cdd-9150-483a-b1dc-cbcbb2d9ae18 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.497892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 781/1549] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.499170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.499458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.499733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.521816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.522974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.522974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.523335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.523738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.524516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.524766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:44:59.524766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:44:59.524766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:44:59.525945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.526111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b95ef-3416-48de-8780-8ef214f3257a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.539751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 782/1550] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.540599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.551644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03124d-4af1-4f46-a918-e0881bff2c48 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.557556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 769/1551] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:59.557556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7d4f-8f01-4782-aac4-ea5e79098b08 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.557556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7d4f-8f01-4782-aac4-ea5e79098b08 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.557556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb7d4f-8f01-4782-aac4-ea5e79098b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.559773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.560393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.560694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.560985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.561645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.563571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7466e-6df7-4b64-8f6f-c83612ba447f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.580098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-16bb7d4f-8f01-4782-aac4-ea5e79098b08 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.581453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-16bb7d4f-8f01-4782-aac4-ea5e79098b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.590025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 770/1552] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.591054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 783/1553] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:59.591255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1398e-a68d-44f5-bb86-cd90a9d325a3 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.592420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1398e-a68d-44f5-bb86-cd90a9d325a3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.592420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1398e-a68d-44f5-bb86-cd90a9d325a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.592644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb14d5-e13b-4574-a0bf-0f119710fb19 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.592644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb14d5-e13b-4574-a0bf-0f119710fb19 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.592947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb14d5-e13b-4574-a0bf-0f119710fb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.611974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-59e1398e-a68d-44f5-bb86-cd90a9d325a3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.613067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-12cb14d5-e13b-4574-a0bf-0f119710fb19 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.613225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-59e1398e-a68d-44f5-bb86-cd90a9d325a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.614247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-12cb14d5-e13b-4574-a0bf-0f119710fb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.621448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 771/1554] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.622707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.622990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.623100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 784/1555] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.623283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.624295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab811-6bc1-4b5e-8341-22f58bf51b4c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.624575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab811-6bc1-4b5e-8341-22f58bf51b4c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.625172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab811-6bc1-4b5e-8341-22f58bf51b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.644840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.645429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6e7ab811-6bc1-4b5e-8341-22f58bf51b4c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.646151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.646587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6e7ab811-6bc1-4b5e-8341-22f58bf51b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.654325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 772/1556] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.658002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 785/1557] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.658159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.658256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c955-b2c0-4e04-8886-fdbcd8d56f90 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.658256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c955-b2c0-4e04-8886-fdbcd8d56f90 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.658256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c955-b2c0-4e04-8886-fdbcd8d56f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.667930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a9da-b5a4-46ef-94b9-faeed8768925 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.671187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.671792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.672069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.672485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.673226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.675055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.680360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-84e3c955-b2c0-4e04-8886-fdbcd8d56f90 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.682070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-84e3c955-b2c0-4e04-8886-fdbcd8d56f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.686925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 773/1558] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:44:59.687551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.690829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 786/1559] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.694313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896d48-e6ae-4235-b75e-593c8246d8d4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.694600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896d48-e6ae-4235-b75e-593c8246d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.694872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896d48-e6ae-4235-b75e-593c8246d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.697603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efbc7-11aa-4b80-9658-1c655f7af727 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.702399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.702999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.703275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.703543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.704195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.706140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.708789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:59.715283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fe896d48-e6ae-4235-b75e-593c8246d8d4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.716504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fe896d48-e6ae-4235-b75e-593c8246d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.721630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 774/1560] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:44:59.721630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.726012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 787/1561] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.727405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.727688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.727955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.733850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30af0f-dac0-42a3-a1d2-fca343e0a04b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.739394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.740002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.740275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.740535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.741227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.741501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.743123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.747211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.748518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.756025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 775/1562] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.756847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.757438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 788/1563] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.758157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.768603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72299-12c8-4673-91ba-f35d4d9e6f6d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.770961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cffa6-1fd8-4d33-a4dd-2b34d079d438 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.773834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.774441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.774713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.774964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.775608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.775730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.775905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.776318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.776539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.776809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.777479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.777592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.777779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.779351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b78330-1730-4770-ae36-bb647f9a7b3e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.789147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 789/1564] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.789954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.796202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 776/1565] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.797700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.797976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.798306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.804651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275a90-7129-41b0-8753-5898d83755df admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.810154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.810780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.811199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.811479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.812132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.813811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.817576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:44:59.818778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:44:59.827998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 790/1566] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:44:59.827998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.828246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 777/1567] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:44:59.828246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.838167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c31c-f59e-4ab7-9ba5-a2917371b075 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.838877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f318b-782e-4288-8a3c-c8f78db77088 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.843469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.843598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.844075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.844185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.844349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.844453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.844660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.844817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.845361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.845526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.845664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.847127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.847266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.857824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 791/1568] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:44:59.858636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.859534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 778/1569] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.861726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.869011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc25b8-593e-416b-91be-e0200f8693af admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.873706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.874303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.874578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.874844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.875483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:44:59.875776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.876440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4c833-1feb-43e5-9a1a-5dcbde7ddaab admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.877436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.882014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.882248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.882520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.882787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.883409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.885404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.886054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:59.893216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 792/1570] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:44:59.893984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.904445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a8ced-1174-4709-9e61-1c131b6fffc9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:44:59.909595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:44:59.910291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:44:59.910560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:44:59.910825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:44:59.911445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:44:59.913415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:44:59.915814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 779/1571] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:59.919834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.944945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 793/1572] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:44:59.945763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:44:59.986385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea750-8f8c-4e30-8321-a6abfaa6bbf7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.006993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5ae9-6e47-4670-a52d-ad3574904cfa admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.011799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.012563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.012924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.013218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] PATH_INFO: `/v3/projects/fa030b50d2254bd8afd5fb8739b258bf/users/ecb39ee87875473684577ddb27d05052/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.029234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa030b50d2254bd8afd5fb8739b258bf, user_id=ecb39ee87875473684577ddb27d05052, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.030334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:45:00.030334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:45:00.030334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:45:00.032312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.045595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.046252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.046528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.046811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.047441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 794/1573] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:44:59 2022] PUT /identity/v3/projects/fa030b50d2254bd8afd5fb8739b258bf/users/ecb39ee87875473684577ddb27d05052/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:00.047568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.048162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.049497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.082824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 780/1574] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:44:59 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.083797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.109749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.111744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9fb0d-7a0d-4720-9055-742e51630d30 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.147070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3fa60-3dc5-427a-8f05-d21b426185f8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.151618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.152290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.152549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.152815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] PATH_INFO: `/v3/projects/0a6cf40933ed45599113f0f20ba22436/users/76c00cbffad2450e8b95a7df7725fc06/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.169816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.170370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.170798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.171156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.171851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:00.172186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.172519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6cf40933ed45599113f0f20ba22436, user_id=76c00cbffad2450e8b95a7df7725fc06, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.174001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.175342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.193091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 795/1575] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:00.193273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 781/1576] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:00 2022] PUT /identity/v3/projects/0a6cf40933ed45599113f0f20ba22436/users/76c00cbffad2450e8b95a7df7725fc06/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:00.193273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.198451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.205030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.210650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a0a23-5e0c-4757-ac88-57845b2d2555 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.260529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7f2e5-2043-4fa7-9c70-0dc481f3065b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.265221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.266176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.266446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.266716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.267389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.269338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.274801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.275443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.275702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.275972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.276604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.278632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.297365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 782/1577] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.297928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.308548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 796/1578] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.309398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.363834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287566ea-ca11-4ec8-90fc-1ab09461efdc admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.368595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.369244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.369513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.369779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.370400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.370555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb5e7-f7ec-4c7a-a275-838e6a1dbcf1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.372332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ab9a8-4904-46ab-979a-725d32be6c27 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.375039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.375614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.375916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.376180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.376879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.378958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.396334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 783/1579] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.397711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.398027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.398264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.402950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 797/1580] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.403946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.413733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869e020-b183-4a92-968f-02aa9d9f0256 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.418387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.418987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.419259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.420259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.420259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.422074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651e1b2-f85d-4431-96c5-63022f3ebe6a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.427080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] MFA Rules not processed for user `ecb39ee87875473684577ddb27d05052`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:00.428299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:00.437043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.449963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 798/1581] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.449963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.449963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.449963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.467730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:00.468979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:00.476678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 799/1582] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:00.480211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.486765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0ba1c-b7a3-421f-bd26-38917d9a71f6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.491551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.492188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.492465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.492735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.493366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.495324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.503380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 784/1583] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:00.504245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.516312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb15b2-2c79-454a-af84-dffcc3e87a04 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.521141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.521730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.522119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.522387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.523016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.524918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.525049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 800/1584] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.529141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.549372 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 785/1585] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.550162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.559684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1965-6c75-4bb6-8262-f6928b294070 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.562716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.592497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b2c-e290-4bd2-854d-416d5bc908f2 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.597140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.597749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.598019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.598288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.598911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.600997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.616168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.616787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.617094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.617369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.618006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.619613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.623144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 801/1586] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.623981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.633340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 786/1587] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.634031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5087fe-18a1-4cc5-bf8d-45c04e736306 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.634232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.638825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.639572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.639856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.641047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.641709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.643522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.644202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790170a6-4b25-4286-9dd6-1629fc8e40a3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.649222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.649817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.650092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.650364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.650988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.652578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.656885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 802/1588] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.656885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.666870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 787/1589] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.667685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.678137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c12c-c77b-4aa0-bb35-bd3e29efebf6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.683736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.684339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.684616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.684886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.685541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.687452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.712202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630edc-303e-4a3a-bb53-af255b30dead admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.716125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.716632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 788/1590] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.716783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.717039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.717306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.717615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.727896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.729430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.739156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 803/1591] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:00.739951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.749049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c2c0-5bff-47e4-8cd9-3bc26af70af3 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.780444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.786419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab257593-5d48-452b-9719-3d857ca477f8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.791973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.792599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.792875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.793178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.793866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.795794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.819967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.820560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.820821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.821149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.821845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.823086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 789/1592] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.824261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.826651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.836510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b612feb-e616-4bec-bc5b-fb9f04ff0adf admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.837821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 804/1593] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.838566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.844933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.845627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.845903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.846343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.847010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.849432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.851297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3735d7-527b-444a-8f37-554ac38b1e50 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.857265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.857782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.858061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.858334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.858975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.860598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 790/1594] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.861323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.863786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.872454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f0e3-8891-4507-a6a4-10bdc1303b4e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.875849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 805/1595] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.876655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.880656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.881342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.881791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.881917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.882518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.884115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.886896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143af96-a1fb-4b6d-9b76-ab2901a7cf50 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.892424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.893165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.893557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.893901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.894828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.894992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 791/1596] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.895499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.896375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.905542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7417c-cf9a-47c3-b0ed-09473deb9eb9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.912362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 806/1597] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.912362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.913474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.914047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.914313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.914583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.915212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.917182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.922881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fea21-c2d7-47ba-aea8-378f098ef0f7 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.931406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.932088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.932489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.932692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.933432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.935421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.947583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 807/1598] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.949007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.955100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 792/1599] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:00 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:00.956024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.960736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b1e0-4cee-4dd8-8b5e-fabf3d4c7b8f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.966178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.966802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.967087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.967607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.967776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee750f2-8048-468a-853b-73652e55f72d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:00.968261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.969917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.978233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:00.978859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:00.979133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:00.979404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:00.980050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:00.981705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:00.986476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 808/1600] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.986476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:00.994659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:00.996838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 793/1601] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:00.997851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.000020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829827-b4f6-4b8a-9e8b-734052987c0b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.006463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.007142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.007420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.007692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] PATH_INFO: `/v3/projects/17138034ef6f4a78bfa7d5b3a56af881/users/88dab4e4b3904ca4a97d44597619dc2d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.008088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9c2a-3aa4-4c5f-8974-d861946f32ec admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.013346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.014128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.014509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.014783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] PATH_INFO: `/v3/projects/eea15e9e3bd4415ca3e055e66b9aed16/users/98e2a4c69c5b401f9a5009aeeda7fb4b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.027329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17138034ef6f4a78bfa7d5b3a56af881, user_id=88dab4e4b3904ca4a97d44597619dc2d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.031018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.031620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea15e9e3bd4415ca3e055e66b9aed16, user_id=98e2a4c69c5b401f9a5009aeeda7fb4b, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.034631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.047287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 809/1602] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:00 2022] PUT /identity/v3/projects/17138034ef6f4a78bfa7d5b3a56af881/users/88dab4e4b3904ca4a97d44597619dc2d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.049165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.057720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 794/1603] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:00 2022] PUT /identity/v3/projects/eea15e9e3bd4415ca3e055e66b9aed16/users/98e2a4c69c5b401f9a5009aeeda7fb4b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.063785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.128501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523d361-1276-425d-aaf8-5bf51103054f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.154876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1d342-cc81-4169-8d79-5291021b0159 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.160694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.161518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.161860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.162196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.163030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.164991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.177233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 795/1604] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:01.178501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.193399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89526d-d12b-46c7-a1ea-b43bf706f893 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.195679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.196566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.197066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.197782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] PATH_INFO: `/v3/projects/afaa2baebaad43cb954c3ae049e52076/users/7655c2965a9144a6aba5f67d5306f4c0/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.199529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.200463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.200745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.201977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.202655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.214213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaa2baebaad43cb954c3ae049e52076, user_id=7655c2965a9144a6aba5f67d5306f4c0, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.214851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.218386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.232971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 796/1605] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:01.233570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.236972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 810/1606] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/afaa2baebaad43cb954c3ae049e52076/users/7655c2965a9144a6aba5f67d5306f4c0/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.238955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.247650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caab508-802a-4198-aedd-09c1d9fad06f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.309075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.316424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5c66-159c-4593-9a6c-af07c1a6a608 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.318265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.319223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.319526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.320354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] PATH_INFO: `/v3/projects/7b064e76960a4e6190919add5957ad42/users/7351cbc020324833b9bb1f8558a93f02/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.321202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.321875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.322151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.322422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] PATH_INFO: `/v3/projects/da51ecc18cf6443dbd8d6bce9830e14b/users/55c2286112584c6596794ff7dd14ee5c/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.338670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b064e76960a4e6190919add5957ad42, user_id=7351cbc020324833b9bb1f8558a93f02, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.340332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da51ecc18cf6443dbd8d6bce9830e14b, user_id=55c2286112584c6596794ff7dd14ee5c, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.341840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593eb0c-ad95-4eb7-bd1a-dca0dfa56530 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.343326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33834579-5876-4444-b3e0-e7db37137ac3 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.345466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.360235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 797/1607] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/7b064e76960a4e6190919add5957ad42/users/7351cbc020324833b9bb1f8558a93f02/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.361431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.361707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.361979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.368991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 811/1608] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/da51ecc18cf6443dbd8d6bce9830e14b/users/55c2286112584c6596794ff7dd14ee5c/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.370406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.370701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.370990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.387401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.388626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.395897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.397458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.474509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 812/1609] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.476374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.477687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 798/1610] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.478798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.495185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edd672-4b42-43f3-a856-71e6860f764b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.497038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec62003-da4c-4d46-b1c2-e14d8a128b6b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.500772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.501587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.502056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.502415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] PATH_INFO: `/v3/projects/4470671f49b84b7aadeff6f5648bd5f7/users/48d622b254f1464aba742a350f5bf20a/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.502521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.503129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.503444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.503727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] PATH_INFO: `/v3/projects/2a40b8d2536c4cff85e04c30127437b4/users/01abb408f3ca43cba93f8ad9230183cf/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.525354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4470671f49b84b7aadeff6f5648bd5f7, user_id=48d622b254f1464aba742a350f5bf20a, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.526130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a40b8d2536c4cff85e04c30127437b4, user_id=01abb408f3ca43cba93f8ad9230183cf, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.528822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd5794-9e1e-4419-a9c5-0ddae2b6df88 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.531035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e83b2-4672-43ea-bc59-9492769ac672 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.548458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 813/1611] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/4470671f49b84b7aadeff6f5648bd5f7/users/48d622b254f1464aba742a350f5bf20a/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.549952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.550301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.550715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.554008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 799/1612] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/2a40b8d2536c4cff85e04c30127437b4/users/01abb408f3ca43cba93f8ad9230183cf/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:01.555375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37812b7-cdf0-4b73-90ec-88c19baa0470 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.555654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37812b7-cdf0-4b73-90ec-88c19baa0470 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.555922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37812b7-cdf0-4b73-90ec-88c19baa0470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.579580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f37812b7-cdf0-4b73-90ec-88c19baa0470 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.580816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f37812b7-cdf0-4b73-90ec-88c19baa0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.589993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] MFA Rules not processed for user `7655c2965a9144a6aba5f67d5306f4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.592025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.659106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 800/1613] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.661672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.662214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.662685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.701218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] MFA Rules not processed for user `55c2286112584c6596794ff7dd14ee5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.702144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 814/1614] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.703254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.707521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.762524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.788131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40700fdf-027d-42a5-9541-6b9bdee524dc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.793306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.794081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.794355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.794621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.796971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 801/1615] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.797947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.799331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.809161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.811770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193107dd-c58f-43e0-a670-f6bcb9ff2c13 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.813851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c734633-cb6d-4838-be00-4dbc14253c10 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.818053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.819346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.819759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.820130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.830966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.832791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.840077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 815/1616] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:01.842110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.842390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.842767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.846870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 802/1617] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:01.851227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.851841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:01.867603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:01.869594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:01.872172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328c9-aed0-43a8-ae36-cc9e82de5c74 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.880947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 816/1618] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:01.882274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.884797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.885464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.885745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.886020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.886672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.891981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.901200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3804e-8cdf-45c9-a598-9c610b282db2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.908510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 803/1619] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:01.909470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.911032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.914163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.914520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.914861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.922626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea956ae-75e1-4923-b359-2df264b7523c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:01.928248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:01.929617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:01.929902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:01.930313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:01.931119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.933605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.937699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:01.939564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:01.952132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 817/1620] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:01.952987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:01.995692 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 804/1621] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:01 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:02.000056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.018232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962038-007e-44a6-ba08-9c8201d77fdb service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.099542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.100488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.100681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.100987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.104028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe6fb-92e8-45f4-b841-0d4449a44ec4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.111586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.112362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.112644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.113002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] PATH_INFO: `/v3/projects/2a40b8d2536c4cff85e04c30127437b4/users/01abb408f3ca43cba93f8ad9230183cf/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.115142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a40b8d2536c4cff85e04c30127437b4, user_id=01abb408f3ca43cba93f8ad9230183cf, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.118078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.132516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 805/1622] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:01 2022] PUT /identity/v3/projects/2a40b8d2536c4cff85e04c30127437b4/users/01abb408f3ca43cba93f8ad9230183cf/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:02.133471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.178254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.179720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.191447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 818/1623] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:02.192459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.260111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedfd-5a2e-4d33-8840-acb75915fb31 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.269778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.270319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.270605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.270875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.271515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.273585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d3366-5648-46ab-afec-ce43bbfaf594 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.319359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1296c-fcd4-49f3-a667-434b6408e045 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.321783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 806/1624] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:02 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:02.323734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.325218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.326682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.335884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.379678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] MFA Rules not processed for user `01abb408f3ca43cba93f8ad9230183cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:02.381553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:02.401261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:02.488192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.488192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.488192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.488192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.532490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.535914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.578614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 819/1625] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:02.581132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.598162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 807/1626] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:02.615586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.620747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6398af7-3d55-4c5b-8511-61068c61c5b5 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.633844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.635491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.636325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.636698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.639076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.642089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.667114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 820/1627] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:02.670844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.695705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0c5c-df15-4767-857e-264cb890e6d1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.706683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.707503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.709401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.711106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] PATH_INFO: `/v3/projects/af031ed793ce4112869c635fffd29a34/users/a3b66149e6e94a3694ceeed078cb7919/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.748143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af031ed793ce4112869c635fffd29a34, user_id=a3b66149e6e94a3694ceeed078cb7919, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.751023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f416d22-92a0-4573-a77c-2fc39ad30684 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.753515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.763871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.764511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.764820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:02.765082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:02.785959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 821/1628] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:02 2022] PUT /identity/v3/projects/af031ed793ce4112869c635fffd29a34/users/a3b66149e6e94a3694ceeed078cb7919/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:02.791202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:02.794112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:02.796266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:02.845749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 808/1629] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:02.991381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fab1-4662-4b63-8d9d-25ee3ee43540 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:02.998571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:02.999386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:02.999807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.000184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.002905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.004785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccdc57-fe40-449b-a85c-04109dff7be0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.031369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 822/1630] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:03.035639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.063950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1451-f357-45e6-b784-078a4f7b4cec service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:03.089021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:03.089716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.089986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.090256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] PATH_INFO: `/v3/projects/af031ed793ce4112869c635fffd29a34/users/a3b66149e6e94a3694ceeed078cb7919/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.099427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af031ed793ce4112869c635fffd29a34, user_id=a3b66149e6e94a3694ceeed078cb7919, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.102381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.148936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 809/1631] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:03 2022] PUT /identity/v3/projects/af031ed793ce4112869c635fffd29a34/users/a3b66149e6e94a3694ceeed078cb7919/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:03.154652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.155136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.155505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.215316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] MFA Rules not processed for user `a3b66149e6e94a3694ceeed078cb7919`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:03.223226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:03.413063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:03.426953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 823/1632] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:03.437611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.544147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349227a-c2fe-4e81-8894-8a48ae201a70 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:03.549955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:03.550918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.551490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.552822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.566785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.568700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.583432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 810/1633] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:03.698079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.748611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:03.764720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6dc82-31fc-4c96-a2fc-80ca8cbe71b8 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:03.774158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:03.777369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.778186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.780271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.860367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4896f-f059-4842-95f2-d0f60946fe2a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:03.871006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:03.871695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:03.871975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:03.872249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] PATH_INFO: `/v3/users/ecb39ee87875473684577ddb27d05052` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:03.875495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb39ee87875473684577ddb27d05052)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.876977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: WARNING py.warnings [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:45:03.876977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: warnings.warn(msg) Aug 24 15:45:03.876977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: Aug 24 15:45:03.890058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.901805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:03.950013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:03.952237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c502b-d0e3-48f4-922e-51acb9c54c66 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:03.974117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 811/1634] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:45:04.045491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb39ee87875473684577ddb27d05052'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:04.046559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb39ee87875473684577ddb27d05052'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:04.047362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb39ee87875473684577ddb27d05052'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:04.077650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb39ee87875473684577ddb27d05052'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:04.094016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb39ee87875473684577ddb27d05052'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:04.128827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 824/1635] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:03 2022] DELETE /identity/v3/users/ecb39ee87875473684577ddb27d05052 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:04.133280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d84-b3fa-43e6-92a6-522198843862 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.133603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d84-b3fa-43e6-92a6-522198843862 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.133940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a5d84-b3fa-43e6-92a6-522198843862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.161525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ef1a5d84-b3fa-43e6-92a6-522198843862 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:04.163063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ef1a5d84-b3fa-43e6-92a6-522198843862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:04.328783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 812/1636] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:04.376679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:04.378287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:04.554288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108fa63-3f3e-4d8c-8a0a-9c6f9f76c5a2 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:04.561306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:04.562572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.563205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.563515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.584249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:04.589452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65cf3-279d-49d0-a29f-c1c3dc3a07f1 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:04.601302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 825/1637] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:04.878203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5328-ca48-495b-b76e-ceab9c7c58f6 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.878940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5328-ca48-495b-b76e-ceab9c7c58f6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.879295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5328-ca48-495b-b76e-ceab9c7c58f6 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.881106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 813/1638] 10.222.0.93 () {54 vars in 962 bytes} [Wed Aug 24 15:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:04.895897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df20ba-4e87-44a0-81a4-f1d7b4f02cd9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:04.896292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df20ba-4e87-44a0-81a4-f1d7b4f02cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:04.897039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df20ba-4e87-44a0-81a4-f1d7b4f02cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:04.944188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:04.957090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-77df20ba-4e87-44a0-81a4-f1d7b4f02cd9 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:04.960237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-77df20ba-4e87-44a0-81a4-f1d7b4f02cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:05.100037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 826/1639] 10.222.0.93 () {58 vars in 1059 bytes} [Wed Aug 24 15:45:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:05.101415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.101807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.102179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.104280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 814/1640] 10.222.0.93 () {54 vars in 912 bytes} [Wed Aug 24 15:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:05.112374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.112912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.113368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.156428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:05.158216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:05.170986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 827/1641] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:05.185900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.188129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:05.288486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f14a34-fd83-4bfb-89ba-6d586b7de7cf None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.294184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.295204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.296344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.296870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.333776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:05.335845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:05.356774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 815/1642] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:05.670769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:05.672477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:05.699367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db0e59-a659-4da7-b364-c3c53a2277d5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:05.727459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:05.728473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:05.728864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:05.729336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] PATH_INFO: `/v3/projects/fa030b50d2254bd8afd5fb8739b258bf` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:05.731815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa030b50d2254bd8afd5fb8739b258bf)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:05.735228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:05.947426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa030b50d2254bd8afd5fb8739b258bf', 'request_id': 'req-64fe163e-720a-4735-bb12-e80782d482ef'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:05.963613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa030b50d2254bd8afd5fb8739b258bf', 'request_id': 'req-64fe163e-720a-4735-bb12-e80782d482ef'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.011307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa030b50d2254bd8afd5fb8739b258bf', 'request_id': 'req-64fe163e-720a-4735-bb12-e80782d482ef'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.044599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] The token cache is being invalidate because project fa030b50d2254bd8afd5fb8739b258bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:06.046151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.049551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-64fe163e-720a-4735-bb12-e80782d482ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.063592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 828/1643] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:05 2022] DELETE /identity/v3/projects/fa030b50d2254bd8afd5fb8739b258bf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:06.071463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:06.113221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869bc39-db5c-4a4e-a1c3-1a156b4338c0 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:06.327251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:06.328074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:06.329232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:06.329623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] PATH_INFO: `/v3/users/01abb408f3ca43cba93f8ad9230183cf` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:06.331775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01abb408f3ca43cba93f8ad9230183cf)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:06.335930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:06.397867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:06.454853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01abb408f3ca43cba93f8ad9230183cf'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.455929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01abb408f3ca43cba93f8ad9230183cf'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.456693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01abb408f3ca43cba93f8ad9230183cf'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.471092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01abb408f3ca43cba93f8ad9230183cf'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.481101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8cd76a76-5ff7-416f-adf9-59d4ddf86d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01abb408f3ca43cba93f8ad9230183cf'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:06.506951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 816/1644] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:06 2022] DELETE /identity/v3/users/01abb408f3ca43cba93f8ad9230183cf => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:07.797359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182af9-fff2-49ba-8983-e281d2e6499d None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.797967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182af9-fff2-49ba-8983-e281d2e6499d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.797967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97182af9-fff2-49ba-8983-e281d2e6499d None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.800515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 829/1645] 10.222.0.93 () {54 vars in 962 bytes} [Wed Aug 24 15:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:07.814937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb10a-0f43-490e-8cb7-5cb87341d94a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.815857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb10a-0f43-490e-8cb7-5cb87341d94a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.816418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb10a-0f43-490e-8cb7-5cb87341d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.851301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-79feb10a-0f43-490e-8cb7-5cb87341d94a None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:07.855210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-79feb10a-0f43-490e-8cb7-5cb87341d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:07.967627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 817/1646] 10.222.0.93 () {58 vars in 1059 bytes} [Wed Aug 24 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:07.974078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.974357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.974777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:07.976567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 830/1647] 10.222.0.93 () {54 vars in 912 bytes} [Wed Aug 24 15:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:07.985598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:07.986022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:07.986662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.042329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:08.043606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:08.081988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 818/1648] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:08.094610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:08.101098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:08.248218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe68dc-0ec5-4e1c-b319-118ee3e919b0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:08.257657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:08.258305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:08.258580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:08.258849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:08.288084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:08.291547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49269e3b-2074-453d-acb0-07b5af526222 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:08.318279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 831/1649] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:09.151566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:09.153076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:09.319913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0768d9-77ac-4a18-aeca-e96d9fd48f2f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:09.324874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:09.325564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.325834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.326269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] PATH_INFO: `/v3/projects/2a40b8d2536c4cff85e04c30127437b4` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.329481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a40b8d2536c4cff85e04c30127437b4)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:09.330716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: WARNING py.warnings [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:45:09.330716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: warnings.warn(msg) Aug 24 15:45:09.330716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: Aug 24 15:45:09.332243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:09.444348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:09.497170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a40b8d2536c4cff85e04c30127437b4', 'request_id': 'req-aba7ba35-6749-45f5-8df0-bd508944c4f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:09.511119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a40b8d2536c4cff85e04c30127437b4', 'request_id': 'req-aba7ba35-6749-45f5-8df0-bd508944c4f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:09.534796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a40b8d2536c4cff85e04c30127437b4', 'request_id': 'req-aba7ba35-6749-45f5-8df0-bd508944c4f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:09.559342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] The token cache is being invalidate because project 2a40b8d2536c4cff85e04c30127437b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:09.559674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:09.560602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-aba7ba35-6749-45f5-8df0-bd508944c4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:09.564267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 819/1650] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:09 2022] DELETE /identity/v3/projects/2a40b8d2536c4cff85e04c30127437b4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:09.567204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.568079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.568604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.599270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:09.601324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:09.615724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:09.686542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 832/1651] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:09.694288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.694583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.695313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.741161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:09.742501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:09.770996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 820/1652] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:09.775854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:09.795054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b5fa-885e-4808-bb5c-1401b7e1fd7f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:09.810781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:09.812418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.812937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.814552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.816165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:09.817716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:09.822630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:09.858255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 833/1653] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:09.861798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:09.886527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68343e91-aeef-4824-b33d-0cc9d091841a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:09.904632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:09.905736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:09.906015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:09.906282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:09.906932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:09.909131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:09.980181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 821/1654] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:09 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:09.983368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.000645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844ab84-d524-4062-af76-1904d34891ce admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.249597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.265098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.265386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.266136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.266872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.269215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.301783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 834/1655] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:09 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:10.306570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.321916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa724af-2418-478f-9d5e-15bf2b6c0a3c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.329777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.330638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.331124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.331557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.332631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.340485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.358785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 822/1656] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:10.365337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.407884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791282e-0d0e-4080-9992-eab9cbaf0760 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.426947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.427907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.428274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.429281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.430112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.431908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2800e59-59c1-40b1-8b89-e00e7c44aac9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.447594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 835/1657] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:10.452071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:10.469761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e33f-37fd-41a2-8ca0-cd0f2dc848e6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:10.490920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:10.493316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.495536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.496855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] PATH_INFO: `/v3/projects/0212dfcb29294e0fb25b3177691e21aa/users/1704b311187444439fce9771c547d9f8/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.550384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0212dfcb29294e0fb25b3177691e21aa, user_id=1704b311187444439fce9771c547d9f8, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:10.553329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:10.594848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 823/1658] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:10 2022] PUT /identity/v3/projects/0212dfcb29294e0fb25b3177691e21aa/users/1704b311187444439fce9771c547d9f8/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:10.596700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:10.597199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:10.597407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:10.695608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] MFA Rules not processed for user `1704b311187444439fce9771c547d9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:10.697725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:10.906867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 836/1659] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:10.912226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.078748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dc309-2595-4d4d-aa11-6dbce7c251a7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.091802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.092514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.092824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.093149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.093861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.097707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.200654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 824/1660] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:10 2022] POST /identity/v3/projects => generated 387 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:11.205210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.222368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5b86-b546-4b47-9e7c-fb0d461bb369 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.237768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.368012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.369010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.369505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.369974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.370835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.374333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.461800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 837/1661] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:11 2022] POST /identity/v3/users => generated 300 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:11.463232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.478416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb266f-ab64-4c64-a107-45f67464f6d0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.490112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.490888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.492206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.492206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.492206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.494101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.524576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 825/1662] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:11.526043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.541528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93ec15-d5e6-434c-b572-93fea2d54c8a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.560398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.561318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.561707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.562175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] PATH_INFO: `/v3/projects/508edc5924be4279939d33381526d9b4/users/5f1e68a4379b4ddfbfe80b7d511efaf9/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.618863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=508edc5924be4279939d33381526d9b4, user_id=5f1e68a4379b4ddfbfe80b7d511efaf9, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:11.621777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e4766-aa12-4ca4-92b0-1056ef9a0eae admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:11.665201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 838/1663] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:11 2022] PUT /identity/v3/projects/508edc5924be4279939d33381526d9b4/users/5f1e68a4379b4ddfbfe80b7d511efaf9/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:11.669334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:11.683807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233de2e1-7ba0-42e9-9480-56fbca403a7b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:11.710219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200aa-3ad3-41e2-8b35-056e4928e9ed None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:11.710688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200aa-3ad3-41e2-8b35-056e4928e9ed None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:11.711188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b200aa-3ad3-41e2-8b35-056e4928e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:11.814334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:11.818827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-56b200aa-3ad3-41e2-8b35-056e4928e9ed None None] MFA Rules not processed for user `76c00cbffad2450e8b95a7df7725fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:11.828480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-56b200aa-3ad3-41e2-8b35-056e4928e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:11.996312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:11.998939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.000436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.000436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.001473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.007419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.045298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 826/1664] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:12.052256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.096645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564972d9-ac63-4d53-b9c8-7562894b33bd admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.131163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.132026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.133463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.133577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] PATH_INFO: `/v3/projects/508edc5924be4279939d33381526d9b4/users/5f1e68a4379b4ddfbfe80b7d511efaf9/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.145647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508edc5924be4279939d33381526d9b4, user_id=5f1e68a4379b4ddfbfe80b7d511efaf9, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.155808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27571-5599-45bf-b522-e36e8a507424 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.180963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 839/1665] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:12.184551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.184551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.184551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.220442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 827/1666] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:12 2022] PUT /identity/v3/projects/508edc5924be4279939d33381526d9b4/users/5f1e68a4379b4ddfbfe80b7d511efaf9/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:12.222522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.223172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.223432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.262777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] MFA Rules not processed for user `76c00cbffad2450e8b95a7df7725fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:12.269478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:12.337189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] MFA Rules not processed for user `5f1e68a4379b4ddfbfe80b7d511efaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:12.341908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:12.502243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 840/1667] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:12.512817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.514596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:12.570729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:12.625235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 828/1668] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:12.638309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:12.640889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:12.877487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95551-58d1-4079-bced-5a1c546e9ebc None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.898936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ad8d-c181-4207-8465-46d77e0f0050 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:12.909334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.909995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.910275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.910548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.910695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:12.911620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:12.912226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:12.912651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:12.951374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.952843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.954657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:12.956346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be829e-a6f2-4de2-a5bb-e22b70ebf37f service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:12.987426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 829/1669] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:45:13.004279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 841/1670] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:13.056339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:13.220622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:13.326908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8f51e-7e3a-4b73-acb5-8bfa2e6d53af service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:13.357257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:13.357930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:13.358364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:13.358638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] PATH_INFO: `/v3/users/1704b311187444439fce9771c547d9f8` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:13.368605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1704b311187444439fce9771c547d9f8)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:13.370669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:13.500886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1704b311187444439fce9771c547d9f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:13.503475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1704b311187444439fce9771c547d9f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:13.505287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1704b311187444439fce9771c547d9f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:13.537447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1704b311187444439fce9771c547d9f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:13.548130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1704b311187444439fce9771c547d9f8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:13.587583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 830/1671] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:13 2022] DELETE /identity/v3/users/1704b311187444439fce9771c547d9f8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:13.592780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e536-9149-46c7-af38-bf61bb712516 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:13.593107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e536-9149-46c7-af38-bf61bb712516 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:13.593383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e536-9149-46c7-af38-bf61bb712516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:13.634764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8310e536-9149-46c7-af38-bf61bb712516 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:13.640097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8310e536-9149-46c7-af38-bf61bb712516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:13.835752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 842/1672] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:13.851769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:13.854072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:14.035528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad485-41fe-4868-bc61-182b87accecb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.043912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.044735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.045156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.045536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.071803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.073515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9841af-ec1e-4c78-9b87-93d7444fbcfd service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.096578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 831/1673] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:14.194122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae46e3-781e-447e-a763-2ef240c2e4a8 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.194606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae46e3-781e-447e-a763-2ef240c2e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.194917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae46e3-781e-447e-a763-2ef240c2e4a8 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.196063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 843/1674] 10.222.0.93 () {54 vars in 912 bytes} [Wed Aug 24 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:14.202270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.202555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.202832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.326223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:14.327936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:14.355677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 832/1675] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:14.409663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae46e3-781e-447e-a763-2ef240c2e4a8 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:14.433556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae46e3-781e-447e-a763-2ef240c2e4a8 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:14.453698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:14.456000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:14.456503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:14.458010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:14.473005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:14.475409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:14.489179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 844/1676] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:15.675128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:15.677316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:15.718804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21774d07-200c-4265-8dbc-c1f21c5bdb6d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:15.735289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:15.736034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:15.736426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:15.736713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] PATH_INFO: `/v3/projects/0212dfcb29294e0fb25b3177691e21aa` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:15.739488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0212dfcb29294e0fb25b3177691e21aa)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:15.743489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:15.873339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:15.905850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0212dfcb29294e0fb25b3177691e21aa', 'request_id': 'req-3106a03b-3dff-4277-8099-ed2863d1ec96'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:15.925590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0212dfcb29294e0fb25b3177691e21aa', 'request_id': 'req-3106a03b-3dff-4277-8099-ed2863d1ec96'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:15.940879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0212dfcb29294e0fb25b3177691e21aa', 'request_id': 'req-3106a03b-3dff-4277-8099-ed2863d1ec96'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:15.980783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] The token cache is being invalidate because project 0212dfcb29294e0fb25b3177691e21aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:15.981341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:15.982271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3106a03b-3dff-4277-8099-ed2863d1ec96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.009072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 833/1677] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:15 2022] DELETE /identity/v3/projects/0212dfcb29294e0fb25b3177691e21aa => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:16.012824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:16.042251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b49ce4-ac5a-4df3-bacf-54251ab5bbcc service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:16.190820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13b12-1d94-4e7b-8c18-e32a21fba867 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.192881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13b12-1d94-4e7b-8c18-e32a21fba867 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.193404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae13b12-1d94-4e7b-8c18-e32a21fba867 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.196093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 834/1678] 10.222.0.93 () {54 vars in 961 bytes} [Wed Aug 24 15:45:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:16.213153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.214997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.215721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.267900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:16.269608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.270357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.273361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] PATH_INFO: `/v3/users/5f1e68a4379b4ddfbfe80b7d511efaf9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.275688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1e68a4379b4ddfbfe80b7d511efaf9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:16.281731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:16.283129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:16.289529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:16.351489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:16.418059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1e68a4379b4ddfbfe80b7d511efaf9'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.418979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1e68a4379b4ddfbfe80b7d511efaf9'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.428693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1e68a4379b4ddfbfe80b7d511efaf9'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.474597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1e68a4379b4ddfbfe80b7d511efaf9'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.504176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-61a3309c-6161-45b4-9e87-acc6063881b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1e68a4379b4ddfbfe80b7d511efaf9'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.523400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 835/1679] 10.222.0.93 () {58 vars in 1058 bytes} [Wed Aug 24 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 15:45:16.526334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:16.532578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:16.557446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 845/1680] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:16 2022] DELETE /identity/v3/users/5f1e68a4379b4ddfbfe80b7d511efaf9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:16.562302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.564506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.564864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.582985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0df24-d70a-46f2-8dcd-57fe1a632819 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:16.628821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] MFA Rules not processed for user `76c00cbffad2450e8b95a7df7725fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:16.632600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:16.803794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:16.806076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:16.809782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:16.810353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] PATH_INFO: `/v3/users/55c2286112584c6596794ff7dd14ee5c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:16.812398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c2286112584c6596794ff7dd14ee5c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:16.815300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:16.898678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 846/1681] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:16.901977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:16.977740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c2286112584c6596794ff7dd14ee5c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.979381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c2286112584c6596794ff7dd14ee5c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:16.980415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c2286112584c6596794ff7dd14ee5c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:17.066710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.076643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c2286112584c6596794ff7dd14ee5c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:17.092182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-9e073e05-65f6-4489-b265-7cda4c1d080d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c2286112584c6596794ff7dd14ee5c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:17.121793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 836/1682] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:16 2022] DELETE /identity/v3/users/55c2286112584c6596794ff7dd14ee5c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:17.127114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.129261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.130124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.137686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa080c3-adc3-484e-9b58-34935ee99eec None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.180438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:17.183952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:17.270985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:17.303352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.304261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.305216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.305616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.308600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:17.348411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.350458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.357645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 837/1683] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:17.364172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 847/1684] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:17.376484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:17.378138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:17.525242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42004ce-aec1-40ee-85af-58e15fc8ce01 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:17.540114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:17.540946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:17.541235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:17.541506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:17.557065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:17.559922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e25d7e-7b46-4bd8-9cdc-d5e9cb05a2ca service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:17.583245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 838/1685] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:18.928337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:18.930549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:18.960725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab976e-a455-4814-b81a-6e34e30c2670 service placement] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:18.990374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:18.991072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:18.991350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:18.991627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] PATH_INFO: `/v3/projects/508edc5924be4279939d33381526d9b4` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:18.993066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=508edc5924be4279939d33381526d9b4)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:18.995079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.158420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508edc5924be4279939d33381526d9b4', 'request_id': 'req-dbd97a9a-20bd-4504-84c9-0e2300d11bec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.175799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508edc5924be4279939d33381526d9b4', 'request_id': 'req-dbd97a9a-20bd-4504-84c9-0e2300d11bec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.184249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508edc5924be4279939d33381526d9b4', 'request_id': 'req-dbd97a9a-20bd-4504-84c9-0e2300d11bec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.213859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] The token cache is being invalidate because project 508edc5924be4279939d33381526d9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:19.214159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.215095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dbd97a9a-20bd-4504-84c9-0e2300d11bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.226467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 848/1686] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:18 2022] DELETE /identity/v3/projects/508edc5924be4279939d33381526d9b4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:19.232048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc650d-94d0-4496-9cf3-c847ca182a0d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.232048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc650d-94d0-4496-9cf3-c847ca182a0d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.232514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc650d-94d0-4496-9cf3-c847ca182a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.263929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d5fc650d-94d0-4496-9cf3-c847ca182a0d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.266952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d5fc650d-94d0-4496-9cf3-c847ca182a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.314008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.314302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.314558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.398179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] MFA Rules not processed for user `7351cbc020324833b9bb1f8558a93f02`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.399581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.444977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 839/1687] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:19.453729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.454361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.454788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.490200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.491506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.504333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 840/1688] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:19.504333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.506155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.536488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1463-8398-4eb5-92b0-3fc716438419 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.544250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.544974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.545243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.545525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] PATH_INFO: `/v3/projects/da51ecc18cf6443dbd8d6bce9830e14b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.547026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da51ecc18cf6443dbd8d6bce9830e14b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.549317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.564148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 849/1689] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:19.564739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:19.566420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.581989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c66bd-7499-4352-996d-5e93b7c980d1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.588608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.589291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.589576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.589954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.590529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:19.590785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.592999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01134fb-9500-43a0-bc9a-c5548eca2c59 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.606489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 850/1690] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:19.608820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.609124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.609390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.619200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da51ecc18cf6443dbd8d6bce9830e14b', 'request_id': 'req-2d2ab8ca-11a8-495f-a79a-f6bcce822581'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.630214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da51ecc18cf6443dbd8d6bce9830e14b', 'request_id': 'req-2d2ab8ca-11a8-495f-a79a-f6bcce822581'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.641900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] MFA Rules not processed for user `98e2a4c69c5b401f9a5009aeeda7fb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.643078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da51ecc18cf6443dbd8d6bce9830e14b', 'request_id': 'req-2d2ab8ca-11a8-495f-a79a-f6bcce822581'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.643753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.678181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] The token cache is being invalidate because project da51ecc18cf6443dbd8d6bce9830e14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:19.681140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.682092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2d2ab8ca-11a8-495f-a79a-f6bcce822581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:19.689482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 841/1691] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:19 2022] DELETE /identity/v3/projects/da51ecc18cf6443dbd8d6bce9830e14b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:19.689482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4355c-2544-4efd-a679-305fa200dc77 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.689482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4355c-2544-4efd-a679-305fa200dc77 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.689482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4355c-2544-4efd-a679-305fa200dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.714142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-cdf4355c-2544-4efd-a679-305fa200dc77 None None] MFA Rules not processed for user `7351cbc020324833b9bb1f8558a93f02`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.715554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cdf4355c-2544-4efd-a679-305fa200dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.722661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:19.826537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 851/1692] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:19.827957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.829901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.843112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 842/1693] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:19.844820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.845659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.846483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.869677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:19.870911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.916536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfeb0-7024-4eaa-bc8a-f17a55a5a5b4 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:19.922450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:19.923369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.923838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.924381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:19.925447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:19.927769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dd7c8-7133-4a98-936e-7598dbe990c5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:19.944910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 843/1694] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:19.946087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:19.950141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:19.976236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 852/1695] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:19.976236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:19.976236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:19.976236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.017126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:20.018466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:20.083315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.166362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 853/1696] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:20.167223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.188990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5594d52-ea79-4f4d-a74f-249ab28570d3 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.194650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b14c7-2b56-4f50-bc9d-2e2b1948beed None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.221765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.229756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.230159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.230312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.230962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.243428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.333220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 854/1697] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:20.334415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.371613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ed11-8089-46d7-961a-eda34b1e7d49 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.390113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.391278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.391709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.392116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.393294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:20.393755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.395531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.396154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.396425 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.396771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.398311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.480823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 855/1698] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:20.481843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.486704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.488374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.491796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:20.501694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 844/1699] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:20.502475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.514424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7ef9-ab81-4703-be4f-0ec7e56f29e0 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.522557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.523273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.523596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.523864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.524553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.527640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.543594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 845/1700] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:20.548672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.562194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da201724-0ecc-4a37-b4f3-eab25857ae2e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.563361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bbfb1-eeca-403a-ba23-60c2a46b551f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.575597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.576952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.577378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.578208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.579609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.584572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.591199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.592359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.592832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:20.594081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:20.597612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:20.657518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 846/1701] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:20.663582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.681694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.823221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:20.829692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:20.875019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:20.880544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 856/1702] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:20.884660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:20.947233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf8fdb-09f3-4b74-ba67-601dff9a2939 service nova] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.957094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b77c3c-092f-4e8d-9fa1-0503448be28c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:20.977563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:20.978222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:20.978614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.020063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.020748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.022321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.023940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.026185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.026718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.035952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.040123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.044077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873775b5-f971-403d-b2c1-5208b17d3d7c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.103533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 847/1703] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:21.110649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba2e0-7aec-4b37-a425-a71e7041484f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.111073 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba2e0-7aec-4b37-a425-a71e7041484f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.111445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba2e0-7aec-4b37-a425-a71e7041484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.123506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 857/1704] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:20 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:21.130696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.163909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ac17-7dc1-435b-9ee1-f6edc09ec2f1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.188233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.191997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.192725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.193236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] PATH_INFO: `/v3/projects/7f0bef6c5b744b58a4083c09cf84748b/users/d40283121d2649a38f630f002eb41079/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.225884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0bef6c5b744b58a4083c09cf84748b, user_id=d40283121d2649a38f630f002eb41079, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.228990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.292397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 858/1705] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:21 2022] PUT /identity/v3/projects/7f0bef6c5b744b58a4083c09cf84748b/users/d40283121d2649a38f630f002eb41079/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:21.292397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.345889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2d2ba2e0-7aec-4b37-a425-a71e7041484f None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:21.348125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2d2ba2e0-7aec-4b37-a425-a71e7041484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:21.549538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc6049-4577-434b-9def-d1e1bacf22c0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.561933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.563780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.564078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.564344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.565092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.566815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.593605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 848/1706] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:21.596454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.596745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.597051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.598040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 859/1707] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:21.602626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.630140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9925-25be-47a3-b370-6819d4e2d6cf admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.663251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.663912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.664193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.664464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.666498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.670318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.686794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] MFA Rules not processed for user `d40283121d2649a38f630f002eb41079`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:21.689699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:21.695943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 860/1708] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:21.697162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.717156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939711b6-2e28-4b67-8f57-b566c5900155 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:21.730946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:21.731645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.731921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.732195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] PATH_INFO: `/v3/projects/85cf9eb41bd046ed9cd7203b33ef6a6d/users/ec003aae35c04d7db18118094fc61632/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.792836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cf9eb41bd046ed9cd7203b33ef6a6d, user_id=ec003aae35c04d7db18118094fc61632, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:21.802517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a977574-5594-441a-9b17-d967715ab82e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:21.871805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 861/1709] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:21 2022] PUT /identity/v3/projects/85cf9eb41bd046ed9cd7203b33ef6a6d/users/ec003aae35c04d7db18118094fc61632/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:21.884265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:21.884864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:21.885354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:21.942600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 849/1710] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:21.943533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:21.949810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:21.983002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] MFA Rules not processed for user `ec003aae35c04d7db18118094fc61632`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:21.984276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:22.088887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:22.099418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:22.209861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceb512-c4d8-4de6-83cc-7be2256d307e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:22.253332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 862/1711] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:22.258830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:22.415896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:22.416711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:22.417203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:22.418263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:22.487986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa961f-326e-450d-b902-550a3d494117 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:22.494885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:22.495529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:22.495833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:22.496214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:22.497046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:22.499009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:22.595468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:22.597453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:22.630053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 850/1712] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:45:22.630593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:22.725607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 863/1713] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:22 2022] POST /identity/v3/projects => generated 393 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:22.726936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.056865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ed58-810d-4221-9399-8abb716e669d service swift] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.067276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:23.083915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9877f-3f1b-49db-b0e2-c1ec39c8e0e9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.126328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.127892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.129744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.138741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.139619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:23.149394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:23.265870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.266762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.267283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.267500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.289372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 864/1714] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:22 2022] POST /identity/v3/users => generated 303 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:23.292555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.364375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6778-f50c-4375-970f-f31705ff926f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.420109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:23.421880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:23.427618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.431652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.433202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.434725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.439924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:23.447535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 851/1715] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:23.450841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:23.530862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 865/1716] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:23.532510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.547513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2262-7285-40d0-aad5-07f50b3c709d service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.583957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.584665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.585036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.585311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] PATH_INFO: `/v3/projects/d41c714f93504aa6b10029deef6364da/users/7275539a22da40a2aad5c9524a5a3f45/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.637378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c714f93504aa6b10029deef6364da, user_id=7275539a22da40a2aad5c9524a5a3f45, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:23.639985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:23.697318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 852/1717] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:23 2022] PUT /identity/v3/projects/d41c714f93504aa6b10029deef6364da/users/7275539a22da40a2aad5c9524a5a3f45/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:23.698899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:23.719827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bca0e-c7fa-48a5-8c10-686fc3a470a6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:23.856119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:23.969726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:23.970484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:23.970838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:23.971180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:23.971929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:23.979701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a55c0b-45e6-4bb5-a815-e2da07126f94 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.022025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 866/1718] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:24.024608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.050738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782411b-a0f7-40d8-8535-aab8ecbb301c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:24.082656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:24.083727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.084209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.084606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] PATH_INFO: `/v3/projects/d41c714f93504aa6b10029deef6364da/users/7275539a22da40a2aad5c9524a5a3f45/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.090211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c714f93504aa6b10029deef6364da, user_id=7275539a22da40a2aad5c9524a5a3f45, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:24.105111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:24.155352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:24.156138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 853/1719] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:24 2022] PUT /identity/v3/projects/d41c714f93504aa6b10029deef6364da/users/7275539a22da40a2aad5c9524a5a3f45/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:24.156249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:24.156249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:24.333680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] MFA Rules not processed for user `7275539a22da40a2aad5c9524a5a3f45`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:24.334953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:24.743841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 867/1720] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:24.765264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:24.768924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:25.021986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1750-7066-4fe7-9104-4f5f52f88042 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.028837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.029815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.030069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.030382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.133256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.136269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc462f2c-4529-4681-9780-9a9256e5ab3e service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.180376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 854/1721] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:25.350157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:25.354403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:25.415372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4412b-79a4-484e-800d-e195cd37f9bf None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:25.436608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:25.437459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.437847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.438805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.527227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:25.527602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:25.527988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:25.621684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:25.668132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] MFA Rules not processed for user `88dab4e4b3904ca4a97d44597619dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:25.669465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:25.772924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:25.777145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:25.825425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 868/1722] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:25.828009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:26.055852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 855/1723] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:26.067009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:26.216059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:26.227766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d033d-18cd-4205-9765-d2a232e4c1f8 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:26.274261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:26.276600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:26.282624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:26.292085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] PATH_INFO: `/v3/users/ec003aae35c04d7db18118094fc61632` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:26.299079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec003aae35c04d7db18118094fc61632)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:26.309822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:26.468989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec1bb-268c-4055-877a-b40d388fd29a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:26.484210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec003aae35c04d7db18118094fc61632'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:26.489799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec003aae35c04d7db18118094fc61632'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:26.490922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec003aae35c04d7db18118094fc61632'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:26.493874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:26.495415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:26.495703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:26.495974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:26.501393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:26.575505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec003aae35c04d7db18118094fc61632'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:26.589645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:26.600225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6e673-f805-4acd-80da-5cedc6fa6df4 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:26.638264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-648723c5-e2f1-4c92-9754-c84c61824fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec003aae35c04d7db18118094fc61632'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:26.682114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 856/1724] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:26.700190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 869/1725] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:25 2022] DELETE /identity/v3/users/ec003aae35c04d7db18118094fc61632 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:26.705575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:26.706061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:26.706379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:26.755916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:26.764311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:27.027246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 857/1726] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:27.054034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a4bf-ff23-48ec-a650-7a20251c531d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.054034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a4bf-ff23-48ec-a650-7a20251c531d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.054034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292a4bf-ff23-48ec-a650-7a20251c531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.110809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.113529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:27.119708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f292a4bf-ff23-48ec-a650-7a20251c531d None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:27.125829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f292a4bf-ff23-48ec-a650-7a20251c531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:27.181318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:27.261710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1baf55-729a-49c1-a716-46197b801f4d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:27.269362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:27.270086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.270974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.271311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.284308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:27.286303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:27.304434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 858/1727] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:27.361625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 870/1728] 10.222.0.99 () {58 vars in 1015 bytes} [Wed Aug 24 15:45:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:27.682664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:27.703287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6db2-3b07-4ac9-a036-f87e681bb239 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:27.724454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:27.727572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:27.728862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:27.730477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:27.773125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:27.774651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:27.847392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 859/1729] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:29.229112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:29.229625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:29.229711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:29.364045 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] MFA Rules not processed for user `48d622b254f1464aba742a350f5bf20a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:29.374960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:29.793727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 871/1730] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:29.805710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:29.812236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:30.367343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9df2-28eb-4280-b097-ffe1d613a0ee service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:30.392527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:30.393631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:30.394109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:30.394735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:30.408450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:30.410560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af177e-ca3f-4ace-b53d-170c71669ee2 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:30.432420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 860/1731] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:32.583539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:32.585793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:32.616326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38583ef3-0b28-4adc-bb20-23d4ee57c514 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:32.629549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:32.630385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:32.630800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:32.631360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] PATH_INFO: `/v3/users/d40283121d2649a38f630f002eb41079` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:32.632845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40283121d2649a38f630f002eb41079)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:32.635286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:32.661347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:32.747605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40283121d2649a38f630f002eb41079'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:32.748548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40283121d2649a38f630f002eb41079'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:32.752133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40283121d2649a38f630f002eb41079'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:32.818139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40283121d2649a38f630f002eb41079'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:32.842188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40283121d2649a38f630f002eb41079'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:32.892741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 872/1732] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:32 2022] DELETE /identity/v3/users/d40283121d2649a38f630f002eb41079 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:32.897709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:32.898838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:32.899470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:32.939254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:32.946037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:33.213905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 861/1733] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:33.654056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:33.654056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:33.943186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fafc7-9ca6-45e2-8d51-c00bb7d7caf8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:33.964572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:33.967182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:33.967462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:33.973036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.011766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.013316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9f49a-7df3-4a84-b87c-2b8b08254bc0 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.064798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 873/1734] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:34.137600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.139996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:34.173785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668fe5b-5f34-4bf5-9b0c-8708a9c56b31 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.212787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.214976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.218428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.222958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] PATH_INFO: `/v3/projects/85cf9eb41bd046ed9cd7203b33ef6a6d` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.226444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85cf9eb41bd046ed9cd7203b33ef6a6d)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.240973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.394686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:34.425907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85cf9eb41bd046ed9cd7203b33ef6a6d', 'request_id': 'req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:34.442373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85cf9eb41bd046ed9cd7203b33ef6a6d', 'request_id': 'req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:34.455637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85cf9eb41bd046ed9cd7203b33ef6a6d', 'request_id': 'req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:34.483271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] The token cache is being invalidate because project 85cf9eb41bd046ed9cd7203b33ef6a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:34.483634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:34.485309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8fea1927-bc28-484b-bbe4-c4aa5396ce8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:34.488922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 862/1735] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:34 2022] DELETE /identity/v3/projects/85cf9eb41bd046ed9cd7203b33ef6a6d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:34.494899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.495392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.495739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.573707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:34.581124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:34.711065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 874/1736] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:34.720402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.721117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.721871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.786198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:34.795120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:34.829899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 863/1737] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:34.834547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.848793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299ade7-0f6f-4bc3-98c3-dfa71f84f43b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:34.889503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:34.891836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:34.893105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:34.894399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:34.897815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:34.899181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:34.902005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:34.969163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 875/1738] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:34.970713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:34.989910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6709a-1913-4909-9998-07de4a5ece5e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.039780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.040881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.041167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.041461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.061565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.065876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.168249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 864/1739] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:34 2022] POST /identity/v3/projects => generated 355 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:35.172813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.184366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb548f-4ad0-48fb-9826-71a4d88bc474 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.270559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:35.406125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.407390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.407976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.408538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.409487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.412765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.470033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 876/1740] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:35 2022] POST /identity/v3/users => generated 278 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:35.470798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.499062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5674-6308-463f-bbd3-4a861397cd8c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.533015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.543188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.543877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.545033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.551615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.554108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.590140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 865/1741] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:35.594160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.614963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c5e0a-14d9-46f1-bd34-53d33b8eb725 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.629176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.630108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.630533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.630946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.631780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.633656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3a519-b864-454d-81ab-ac183462dcd8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.666651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 877/1742] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:35.666920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:35.714174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717194-fbc3-4d46-a5c0-0f93c2eece11 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:35.744009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123898a-812d-4086-87fb-706982767123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:35.746358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123898a-812d-4086-87fb-706982767123 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.758416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123898a-812d-4086-87fb-706982767123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.760530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123898a-812d-4086-87fb-706982767123 admin admin] PATH_INFO: `/v3/projects/91fefc54f37a422a84556ce2b95ab74e/users/62cce362339f4253b43c85a1e7939d55/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.833250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123898a-812d-4086-87fb-706982767123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fefc54f37a422a84556ce2b95ab74e, user_id=62cce362339f4253b43c85a1e7939d55, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:35.846336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123898a-812d-4086-87fb-706982767123 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:35.903158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 866/1743] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:35 2022] PUT /identity/v3/projects/91fefc54f37a422a84556ce2b95ab74e/users/62cce362339f4253b43c85a1e7939d55/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:35.915313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398430-6cf3-4123-9cd3-01f5913e7ab3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.916529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398430-6cf3-4123-9cd3-01f5913e7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.917444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398430-6cf3-4123-9cd3-01f5913e7ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:35.946572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:35.947246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:35.947809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:36.037702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] MFA Rules not processed for user `98e2a4c69c5b401f9a5009aeeda7fb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:36.048026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:36.048705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-68398430-6cf3-4123-9cd3-01f5913e7ab3 None None] MFA Rules not processed for user `62cce362339f4253b43c85a1e7939d55`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:36.050285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-68398430-6cf3-4123-9cd3-01f5913e7ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:36.334831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 878/1744] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:36.343837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd5cb-e4ea-4f53-bef4-14fc5795efc7 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:36.343837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd5cb-e4ea-4f53-bef4-14fc5795efc7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:36.343837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fd5cb-e4ea-4f53-bef4-14fc5795efc7 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:36.344131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 867/1745] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:36.344603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 879/1746] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:36.346335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:36.441594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:36.442576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:36.443699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:36.476457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:36.479213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:36.607758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822faa52-9e4c-4e1e-af6e-79acd4557eb5 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:36.620567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:36.620799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 880/1747] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:36.621643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:36.621978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:36.622248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:36.623590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:36.639328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:36.666221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:36.717838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 868/1748] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:36 2022] POST /identity/v3/projects => generated 355 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:36.722723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:36.751566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0e2e2-ba50-4e95-ae7d-e13a7e440658 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:36.808947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:36.971136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:36.973518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:36.973803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:36.974078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:36.974819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:36.980486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:37.043365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 881/1749] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:36 2022] POST /identity/v3/users => generated 284 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:37.043758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.075377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995a9a0-550f-4db8-b76d-5be0aae8f018 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:37.095181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:37.095181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.095181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.107513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.108383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:37.114368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:37.152503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 869/1750] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:37.157551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.176705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de685b36-f986-482a-aa96-baf986ad0cda admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:37.193498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:37.194385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.194683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.196517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] PATH_INFO: `/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83/users/00d61e1f457842cfbb6036ee766b92a8/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.241626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c349044cd0b419eb2e1c1fe7aab9c83, user_id=00d61e1f457842cfbb6036ee766b92a8, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:37.247626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:37.282182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.282616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 882/1751] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:37 2022] PUT /identity/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83/users/00d61e1f457842cfbb6036ee766b92a8/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:37.305120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0ac2-41b2-40c9-b0d8-08f84b197d77 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:37.519361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:37.521152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.521668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.523184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.528602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:37.530634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060678f-4a6b-47e7-8f89-b9365385ec26 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:37.553656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 870/1752] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:37.561123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.577215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6021d3c-5486-48c5-a29d-e4c6b74b1a8e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:37.587245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:37.588816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.589589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.590079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] PATH_INFO: `/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83/users/00d61e1f457842cfbb6036ee766b92a8/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.593688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c349044cd0b419eb2e1c1fe7aab9c83, user_id=00d61e1f457842cfbb6036ee766b92a8, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:37.597114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:37.614669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 883/1753] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:37 2022] PUT /identity/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83/users/00d61e1f457842cfbb6036ee766b92a8/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:37.629506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:37.629698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:37.629979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:37.669458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] MFA Rules not processed for user `00d61e1f457842cfbb6036ee766b92a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:37.670203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:37.795995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 871/1754] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:37.809277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.812178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:37.991165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:37.993751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:38.010681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1426-0444-49da-b241-b49d69096a40 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:38.023528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:38.024278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.024505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.024749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.038501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:38.040451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:38.076510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 884/1755] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:38.184482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:38.195126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7c0ca-8e17-4c29-9244-ede8e91eb385 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:38.197157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:38.201246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:38.202317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.202980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.203662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.234876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa31bde-f2f0-42f2-9209-52f0b2416f0a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:38.249750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:38.251388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.251670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.251941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.280588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:38.281959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3b2c1-4bd3-402a-b049-5c87921efec8 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:38.303299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 872/1756] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:45:38.305428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ce13-7bd9-434a-84a5-0bcdee8e4f8d None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.305902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ce13-7bd9-434a-84a5-0bcdee8e4f8d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.306386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ce13-7bd9-434a-84a5-0bcdee8e4f8d None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.309120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 873/1757] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:45:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:45:38.324027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:38.325210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:38.326611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:38.330569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:38.333466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:38.380917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 885/1758] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:38.419236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:38.424742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:38.468427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 874/1759] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:38.789790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:38.791867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:38.837553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:39.008695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899425-58c2-4f7b-9c6a-e545ae9565f2 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:39.023604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:39.024548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:39.024845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:39.025315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] PATH_INFO: `/v3/projects/7f0bef6c5b744b58a4083c09cf84748b` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:39.029678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0bef6c5b744b58a4083c09cf84748b)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:39.031792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:39.144379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0bef6c5b744b58a4083c09cf84748b', 'request_id': 'req-c2438e7e-dec0-4674-bdce-7169aa00fd79'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.167433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0bef6c5b744b58a4083c09cf84748b', 'request_id': 'req-c2438e7e-dec0-4674-bdce-7169aa00fd79'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.178258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0bef6c5b744b58a4083c09cf84748b', 'request_id': 'req-c2438e7e-dec0-4674-bdce-7169aa00fd79'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.202739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] The token cache is being invalidate because project 7f0bef6c5b744b58a4083c09cf84748b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:39.203701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.213068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.219172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:39.226314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 886/1760] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:38 2022] DELETE /identity/v3/projects/7f0bef6c5b744b58a4083c09cf84748b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:39.238755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28c9b3-e926-40d5-9f19-25eb31f1c1ba None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:39.362221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:39.362887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:39.363357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:39.363791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] PATH_INFO: `/v3/users/7275539a22da40a2aad5c9524a5a3f45` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:39.369821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7275539a22da40a2aad5c9524a5a3f45)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:39.372102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:39.440707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7275539a22da40a2aad5c9524a5a3f45'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.441440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7275539a22da40a2aad5c9524a5a3f45'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.442059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7275539a22da40a2aad5c9524a5a3f45'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.465064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7275539a22da40a2aad5c9524a5a3f45'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.477895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d0a309c9-d98e-4ce4-98f1-97c78e773d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7275539a22da40a2aad5c9524a5a3f45'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:39.501096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 875/1761] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:39 2022] DELETE /identity/v3/users/7275539a22da40a2aad5c9524a5a3f45 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:39.576320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:39.577834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:39.806889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2438e7e-dec0-4674-bdce-7169aa00fd79 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:39.961216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:40.042579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:40.043231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.043489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.043766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.053903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:40.110287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:40.114337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835767-8633-4fe6-b90d-3607515dce15 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:40.174132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 887/1762] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:40.558696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:40.559614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:40.559916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:40.614764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] MFA Rules not processed for user `88dab4e4b3904ca4a97d44597619dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:40.621581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:40.801939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 876/1763] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:41.296096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28455f-9dc9-4913-985c-a9d59f763804 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:41.296669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28455f-9dc9-4913-985c-a9d59f763804 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:41.296669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28455f-9dc9-4913-985c-a9d59f763804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:41.331948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-dd28455f-9dc9-4913-985c-a9d59f763804 None None] MFA Rules not processed for user `48d622b254f1464aba742a350f5bf20a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:41.333222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dd28455f-9dc9-4913-985c-a9d59f763804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:41.479303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 888/1764] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:41.606739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:41.606739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:41.617989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:41.806349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fef091-ae55-4114-bbd5-c9cd230d2247 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:41.816752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:41.818031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:41.818719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:41.819252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] PATH_INFO: `/v3/projects/d41c714f93504aa6b10029deef6364da` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:41.821930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41c714f93504aa6b10029deef6364da)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:41.830956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:41.956383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41c714f93504aa6b10029deef6364da', 'request_id': 'req-d3592e8d-385b-4f8b-a616-2815218bbd48'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:41.976119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41c714f93504aa6b10029deef6364da', 'request_id': 'req-d3592e8d-385b-4f8b-a616-2815218bbd48'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:41.997614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41c714f93504aa6b10029deef6364da', 'request_id': 'req-d3592e8d-385b-4f8b-a616-2815218bbd48'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:42.022600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] The token cache is being invalidate because project d41c714f93504aa6b10029deef6364da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:42.023227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:42.024569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3592e8d-385b-4f8b-a616-2815218bbd48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:42.028527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 877/1765] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:41 2022] DELETE /identity/v3/projects/d41c714f93504aa6b10029deef6364da => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:42.033273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814aa4-2645-4c21-bc4b-a7f7da7eaa53 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.033608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814aa4-2645-4c21-bc4b-a7f7da7eaa53 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.033835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814aa4-2645-4c21-bc4b-a7f7da7eaa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.073475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-23814aa4-2645-4c21-bc4b-a7f7da7eaa53 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:42.074640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-23814aa4-2645-4c21-bc4b-a7f7da7eaa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:42.193711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c72b-4a00-4462-ad91-5b063869758d None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.194109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c72b-4a00-4462-ad91-5b063869758d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.194650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393c72b-4a00-4462-ad91-5b063869758d None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.196195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 878/1766] 10.222.0.93 () {54 vars in 912 bytes} [Wed Aug 24 15:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:42.200155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 889/1767] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:42.211675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.212178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.212616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.212802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41d27-bee9-4208-80d9-975689087695 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.213212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41d27-bee9-4208-80d9-975689087695 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.213587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41d27-bee9-4208-80d9-975689087695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.239718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-88b41d27-bee9-4208-80d9-975689087695 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:42.241947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-88b41d27-bee9-4208-80d9-975689087695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:42.242800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:42.244419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:42.254241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 890/1768] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:42.259210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41d27-bee9-4208-80d9-975689087695 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.273491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41d27-bee9-4208-80d9-975689087695 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.280754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.281577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.281855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.282129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.283215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:42.283601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.290252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.307063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 891/1769] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:42.312552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.326726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bac2-55a0-4ef8-8838-c1c41cc4d16b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.331962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.332607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.332882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.333187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.333915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.335876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.338365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 879/1770] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:42.346035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.348456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:42.365005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c315b-75e5-42a8-ad7e-c0db021629d9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.370603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.371676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.373124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.373567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.383918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.385631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.396201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 892/1771] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:42.402155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.413524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 880/1772] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:42.466934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:42.522077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db0666-d91d-4c24-8d94-5d89e152b1b8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.527806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.529501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.529951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.530526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.531743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.534350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.594344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 893/1773] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:42.598472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.616085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb80d-2c9f-4dba-9700-499a316bdb79 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.624548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.625733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.626184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.626602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.627412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.629591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.644168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 881/1774] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:42.648175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.671444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d04858-73ee-4a25-8a76-226fbac3f317 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.679554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.680494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.681030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.681454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.682542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.684458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163baeb4-eae0-4c75-9f1f-9e8dc38f65af admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.701522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 894/1775] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:42.702209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:42.718879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b653c18-9cf2-42b2-a1a3-d33de65d41aa admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:42.728300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:42.729009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.729292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.729566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] PATH_INFO: `/v3/projects/37caaaf0b7354612bbb92ddfc5c012db/users/13abd00dc6db44f8b421a5055d0c5dac/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.775837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37caaaf0b7354612bbb92ddfc5c012db, user_id=13abd00dc6db44f8b421a5055d0c5dac, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:42.780065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:42.792605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:42.846101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 882/1776] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:42 2022] PUT /identity/v3/projects/37caaaf0b7354612bbb92ddfc5c012db/users/13abd00dc6db44f8b421a5055d0c5dac/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:42.857123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:42.857436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:42.857719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:42.951163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] MFA Rules not processed for user `13abd00dc6db44f8b421a5055d0c5dac`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:42.952611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:43.235808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 895/1777] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:43.237610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:43.424138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:43.426202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:43.506289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3ba43-f9c4-41dc-895e-1b8e39b066c1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:43.523317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:43.524093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.524469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.524836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.525817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:43.528649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:43.572873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 883/1778] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:43 2022] POST /identity/v3/projects => generated 381 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:43.577871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:43.719026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ddc36-a9da-4435-bf40-2ae1f6d17346 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:43.813904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bde7-1121-4f56-85aa-fa60c4a56971 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:43.827442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:43.828163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.828438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.828748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.829807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:43.834477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:43.849357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:43.883495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 884/1779] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:43 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:43.888232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:43.889388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:43.893188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.893826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.894877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] PATH_INFO: `/v3/users/7655c2965a9144a6aba5f67d5306f4c0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.904363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7655c2965a9144a6aba5f67d5306f4c0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:43.909674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:43.911103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857dd87-b8ed-4aac-90cd-7ecdefd47c80 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:43.916488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:43.917143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.917418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.917724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:43.918784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:43.921477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:43.944448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 885/1780] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:43.949988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:43.973069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf42cc-88d0-4725-abe4-095cbfe8da85 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:43.988227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:43.990039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:43.990363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:43.993530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] PATH_INFO: `/v3/projects/3facc10494814bf9b5cfd31081a19ec4/users/cc4d88e34f40498899803aec773e53e6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.028818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3facc10494814bf9b5cfd31081a19ec4, user_id=cc4d88e34f40498899803aec773e53e6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.032717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.045867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7655c2965a9144a6aba5f67d5306f4c0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:44.046885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7655c2965a9144a6aba5f67d5306f4c0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:44.048241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7655c2965a9144a6aba5f67d5306f4c0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:44.081847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7655c2965a9144a6aba5f67d5306f4c0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:44.089721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 886/1781] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:43 2022] PUT /identity/v3/projects/3facc10494814bf9b5cfd31081a19ec4/users/cc4d88e34f40498899803aec773e53e6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:44.096143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.098650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-50148dea-2eef-4ea3-ac71-64a2d3ada32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7655c2965a9144a6aba5f67d5306f4c0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:44.112913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:44.149711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 896/1782] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:43 2022] DELETE /identity/v3/users/7655c2965a9144a6aba5f67d5306f4c0 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:44.154849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.154849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.154849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.233023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:44.262203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:44.267373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:44.417338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93dac3-8db5-44f4-95a4-fe80335c5a73 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.484067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 897/1783] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:44.616516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.619700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.621410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:44.622529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.622838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.624995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.626754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.631031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.661592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 887/1784] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:44.665498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:44.688717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72808283-b515-44d5-b236-e60c4afaf330 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.702025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:44.703011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.703634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.705137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] PATH_INFO: `/v3/projects/3facc10494814bf9b5cfd31081a19ec4/users/cc4d88e34f40498899803aec773e53e6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.709262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3facc10494814bf9b5cfd31081a19ec4, user_id=cc4d88e34f40498899803aec773e53e6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:44.718610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a2a1-45fa-4564-9098-03fd505930d3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:44.745082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 888/1785] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:44 2022] PUT /identity/v3/projects/3facc10494814bf9b5cfd31081a19ec4/users/cc4d88e34f40498899803aec773e53e6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:44.763169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:44.763865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:44.767278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:44.808861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934b53-f37c-4975-909c-3aabb6f40cc1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:44.839021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] MFA Rules not processed for user `cc4d88e34f40498899803aec773e53e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:44.843435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:44.867612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:45.010847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:45.017524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:45.019249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:45.020851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:45.073214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 889/1786] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:45.109927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:45.115718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:45.267541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:45.271420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:45.297793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:45.302466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 898/1787] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:45.307109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534bdea-44dd-4864-bacf-2b944b29ecba None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:45.315578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:45.316347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:45.316873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:45.317275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:45.329037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:45.330823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6864a-928c-491d-b15c-023360bbd50f service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:45.344721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 890/1788] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:45.512633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:45.536254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7c78b-9723-43bc-969a-5638f5e3a805 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:45.553140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:45.554287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:45.554782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:45.555263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:45.560534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:45.688218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:45.690763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf65c0-42e7-4697-a60d-790610e47e77 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:45.705775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 899/1789] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:45.827917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:45.828634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:45.829191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:45.830745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 891/1790] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:45:45.855558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:45.855848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:45.856166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:45.949195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:45.957835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:46.123882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:46.142699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 900/1791] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:46.240802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:46.248609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:46.288011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a34ac-60a2-41b0-8f59-f99f4e68679a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:46.303984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:46.305732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:46.306365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.306639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.306907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.323480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489be43-cd97-4627-8a90-f98b120835a6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:46.325817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:46.327489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2de5-e4fd-4ed2-905f-475690bb31cc service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:46.337330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:46.338375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.338883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.339366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] PATH_INFO: `/v3/users/13abd00dc6db44f8b421a5055d0c5dac` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.345314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13abd00dc6db44f8b421a5055d0c5dac)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:46.347685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:46.350504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 892/1792] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:46.497217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13abd00dc6db44f8b421a5055d0c5dac'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:46.498414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13abd00dc6db44f8b421a5055d0c5dac'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:46.499102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13abd00dc6db44f8b421a5055d0c5dac'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:46.540883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13abd00dc6db44f8b421a5055d0c5dac'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:46.559412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13abd00dc6db44f8b421a5055d0c5dac'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:46.597746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 901/1793] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:46 2022] DELETE /identity/v3/users/13abd00dc6db44f8b421a5055d0c5dac => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:46.603274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.603867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.604151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.660415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:46.661801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:46.800629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 893/1794] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:46.868877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:46.871941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:46.945651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eb9c7-638e-4389-bd51-870a850dd084 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:46.950324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:46.950543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:46.950797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:46.951043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:46.964319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:46.966081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:46.999320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 902/1795] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:47.135796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.137318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:47.152876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829f0e2-6618-40b3-b9f8-b560fe62a00f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.159866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.160668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.161036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.161738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] PATH_INFO: `/v3/projects/afaa2baebaad43cb954c3ae049e52076` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.163171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaa2baebaad43cb954c3ae049e52076)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.165475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.291878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaa2baebaad43cb954c3ae049e52076', 'request_id': 'req-57b6b826-0e67-47de-8fce-41fe0bf025ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.303390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaa2baebaad43cb954c3ae049e52076', 'request_id': 'req-57b6b826-0e67-47de-8fce-41fe0bf025ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.311936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaa2baebaad43cb954c3ae049e52076', 'request_id': 'req-57b6b826-0e67-47de-8fce-41fe0bf025ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.340013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] The token cache is being invalidate because project afaa2baebaad43cb954c3ae049e52076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:47.340520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.341222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.344956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 894/1796] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:47 2022] DELETE /identity/v3/projects/afaa2baebaad43cb954c3ae049e52076 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:47.347180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:47.357936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd6b7-96a3-498d-b3bc-83945c209876 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:47.427845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:47.428571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:47.428943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:47.429292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] PATH_INFO: `/v3/users/a3b66149e6e94a3694ceeed078cb7919` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:47.430670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b66149e6e94a3694ceeed078cb7919)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:47.432712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:47.455883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.541757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b66149e6e94a3694ceeed078cb7919'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.546232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b66149e6e94a3694ceeed078cb7919'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.547369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b66149e6e94a3694ceeed078cb7919'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.591980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b66149e6e94a3694ceeed078cb7919'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.628520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b66149e6e94a3694ceeed078cb7919'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:47.660774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 903/1797] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:47 2022] DELETE /identity/v3/users/a3b66149e6e94a3694ceeed078cb7919 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:48.469764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:48.472606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:48.508310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b826-0e67-47de-8fce-41fe0bf025ea admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:48.734295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:48.735005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:48.735423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:48.735829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] PATH_INFO: `/v3/projects/37caaaf0b7354612bbb92ddfc5c012db` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:48.737902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37caaaf0b7354612bbb92ddfc5c012db)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:48.741177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:48.757979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:48.826583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37caaaf0b7354612bbb92ddfc5c012db', 'request_id': 'req-2e73d7a9-c101-4796-85ce-f91d08235a39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:48.838416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37caaaf0b7354612bbb92ddfc5c012db', 'request_id': 'req-2e73d7a9-c101-4796-85ce-f91d08235a39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:48.855239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37caaaf0b7354612bbb92ddfc5c012db', 'request_id': 'req-2e73d7a9-c101-4796-85ce-f91d08235a39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:48.871670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] The token cache is being invalidate because project 37caaaf0b7354612bbb92ddfc5c012db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:48.872828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:48.874060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:48.877076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 895/1798] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:48 2022] DELETE /identity/v3/projects/37caaaf0b7354612bbb92ddfc5c012db => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:48.881336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:48.883105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:48.906354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a6f1-d0af-489a-8bbe-183180d0210b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:48.933812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:48.936987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:49.035457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:49.036106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.036371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.036646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] PATH_INFO: `/v3/users/cc4d88e34f40498899803aec773e53e6` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.045866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4d88e34f40498899803aec773e53e6)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:49.048152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:49.097489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d7a9-c101-4796-85ce-f91d08235a39 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:49.109838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:49.111882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.114555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.116226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] PATH_INFO: `/v3/projects/af031ed793ce4112869c635fffd29a34` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.118794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af031ed793ce4112869c635fffd29a34)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:49.128667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:49.139830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4d88e34f40498899803aec773e53e6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.141302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4d88e34f40498899803aec773e53e6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.142393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4d88e34f40498899803aec773e53e6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.161855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4d88e34f40498899803aec773e53e6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.171752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-810f32c7-b5f2-42c8-918b-dc79926e9928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4d88e34f40498899803aec773e53e6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.211517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 904/1799] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:48 2022] DELETE /identity/v3/users/cc4d88e34f40498899803aec773e53e6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:49.235663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af031ed793ce4112869c635fffd29a34', 'request_id': 'req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.248402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af031ed793ce4112869c635fffd29a34', 'request_id': 'req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.262637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af031ed793ce4112869c635fffd29a34', 'request_id': 'req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.283268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] The token cache is being invalidate because project af031ed793ce4112869c635fffd29a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:49.283571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.284477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1fa512e8-5b26-4dd0-ad7c-cdeb443aa63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:49.287409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 896/1800] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:48 2022] DELETE /identity/v3/projects/af031ed793ce4112869c635fffd29a34 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:49.292893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.293549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.294132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.353184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:49.354549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:49.370856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:49.547794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 905/1801] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:49.550385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.550883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.550974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.630637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:49.641543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:49.690346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 897/1802] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:49.694823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:49.709418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72143-39d6-409f-bd1e-4d1a570a38ba None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:49.726672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:49.730782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.731087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.732516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.736778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:49.737098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:49.743136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:49.789532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 906/1803] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:45:49.793900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:49.813251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac001-fa8a-46b2-b033-a0e68735b8b6 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:49.840752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:49.845312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:49.846322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:49.846615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:49.850323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:49.852315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:49.907409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:49.939095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 898/1804] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:49 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:49.943045 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:49.961150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de921089-620c-4673-9dec-4cd1f08444c2 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.061428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.062225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.062679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.063136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.063904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.066458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.098211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 907/1805] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:49 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:50.098894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.119540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b13f-d4ff-4824-a9ef-8e8cbc21237e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.142251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.143097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.143528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.144447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.145312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.149924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.184923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 899/1806] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:50.189320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.227908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2a3d0-7d46-4d02-bb56-a2d59b7b1c12 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.239316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.239316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.239316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.239649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.240242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.252287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f898e-d108-4d06-bbfc-35d92412e7e1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.280073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 908/1807] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:50.285080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.302736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c501dd8-3d30-46aa-a8fa-80f0f7f07845 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.311028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.312148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.312718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.314048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] PATH_INFO: `/v3/projects/b3acd68931a04b348dd3a415a1709f7e/users/77e6d83a6d80466e8507445b18b5e009/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.343834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3acd68931a04b348dd3a415a1709f7e, user_id=77e6d83a6d80466e8507445b18b5e009, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.348146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.373934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 900/1808] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:50 2022] PUT /identity/v3/projects/b3acd68931a04b348dd3a415a1709f7e/users/77e6d83a6d80466e8507445b18b5e009/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:50.392886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.393310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.393537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.448781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] MFA Rules not processed for user `77e6d83a6d80466e8507445b18b5e009`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:50.451134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:50.558937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 909/1809] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:50.560615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.683293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1498116-ffbb-489d-b307-fb86c50cb521 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.696019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.696734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.697111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.697445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.699038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.707448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.750577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 901/1810] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:50 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:50.760018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.789871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d436a5-18f6-4509-b76d-9f96c49775f5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:50.804135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:50.820181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:50.821982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:50.911641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:50.912291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:50.912628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:50.912930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:50.913576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:50.915555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:50.981568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 910/1811] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:50 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:50.983109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.002592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25089c-b9cd-4bc7-a342-736938b0b810 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.007725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.008398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f65e5-0a51-4ee4-9a37-856dd16c576d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.008961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.009403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.009827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] PATH_INFO: `/v3/projects/3facc10494814bf9b5cfd31081a19ec4` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.011190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3facc10494814bf9b5cfd31081a19ec4)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.013339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.018991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.019849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.020707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.021089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.022006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.025768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.068503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 911/1812] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:51.072806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.073570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:51.080164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3facc10494814bf9b5cfd31081a19ec4', 'request_id': 'req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:51.088335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620cec7-cd8b-479e-af0f-97cf5305b1c9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.093863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3facc10494814bf9b5cfd31081a19ec4', 'request_id': 'req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:51.101898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3facc10494814bf9b5cfd31081a19ec4', 'request_id': 'req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:51.122166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] The token cache is being invalidate because project 3facc10494814bf9b5cfd31081a19ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:51.122623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:51.123381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a4f5380d-f60c-40e9-91e6-36f2bdce0a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:51.129061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 902/1813] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:50 2022] DELETE /identity/v3/projects/3facc10494814bf9b5cfd31081a19ec4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:51.130606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8278fc-5d43-4370-97e0-cbaf9f7e4e2f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.131003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8278fc-5d43-4370-97e0-cbaf9f7e4e2f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.131361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8278fc-5d43-4370-97e0-cbaf9f7e4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.154531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ce8278fc-5d43-4370-97e0-cbaf9f7e4e2f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:51.156041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ce8278fc-5d43-4370-97e0-cbaf9f7e4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.168084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.168870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.169311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.169585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] PATH_INFO: `/v3/projects/3bfbfd8978664444ad2f9bd4c831e669/users/e4c05d1a8ad5406bb320dc175d29871c/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.189511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfbfd8978664444ad2f9bd4c831e669, user_id=e4c05d1a8ad5406bb320dc175d29871c, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.192730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.216042 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 912/1814] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:51 2022] PUT /identity/v3/projects/3bfbfd8978664444ad2f9bd4c831e669/users/e4c05d1a8ad5406bb320dc175d29871c/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:51.220139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.221979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.239192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 903/1815] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:51.247054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.247536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.247877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.277520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:51.278959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.302422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7d047-d06f-42ea-a8fc-b7cc4ec401a4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.307304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.307939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.308213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.308489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.309217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.310863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.325241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 913/1816] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:45:51.326725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.337850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77910a7-879f-4887-baa2-16bc689b423d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.342915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.343666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.343959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.344281 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] PATH_INFO: `/v3/projects/3bfbfd8978664444ad2f9bd4c831e669/users/e4c05d1a8ad5406bb320dc175d29871c/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.346356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfbfd8978664444ad2f9bd4c831e669, user_id=e4c05d1a8ad5406bb320dc175d29871c, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.349211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3ce46-59a3-4377-bc3a-8d6c7dacdfff admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.352198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:51.362691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 914/1817] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:51 2022] PUT /identity/v3/projects/3bfbfd8978664444ad2f9bd4c831e669/users/e4c05d1a8ad5406bb320dc175d29871c/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:51.375096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.375379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.375657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.410798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] MFA Rules not processed for user `e4c05d1a8ad5406bb320dc175d29871c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:51.412330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.452638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 904/1818] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:51.456878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.472982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a39cd-7464-4fe9-8fa9-f3074d499e27 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.558990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.559732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.560097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.560462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.561381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:45:51.561907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.564851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.589829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 905/1819] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:45:51.595661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.596306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 915/1820] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:45:51.606621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8445f7-12f5-410b-9b3f-3f289a45bbe1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.610017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.611998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.629863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.629863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.629863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.629863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.630293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.632379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.640574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:51.685775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 906/1821] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:51 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:51.693097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.716335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20e39-27ac-44d5-8822-fc040828ce3b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.893803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928fde0-5e5f-4052-927a-779ff2c70ad8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.899643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.901444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.901854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.902292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.903007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.905077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.905900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.906276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:51.906392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.906852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.909590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:51.957820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 907/1822] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:51 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:51.960125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:51.977730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eccae-a27c-4a9a-a3f8-fd25a21b8898 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:51.988342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:51.989075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:51.989437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:51.989764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:51.990486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:51.993330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.014762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 908/1823] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:52.021141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:52.041808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c500-6084-4220-b0dd-5587158cdf14 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:52.045000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:52.060261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:52.060261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.060261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.060261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.060691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:52.063320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.069652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:52.073009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9c0e-85ed-437b-b972-b973c2275aea service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.087218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 909/1824] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:52.092584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:52.102896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 916/1825] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:45:52.110161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb248ad6-e17e-44ee-851c-b3e69a9c1a9c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:52.130038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:52.131464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.132184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.133583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] PATH_INFO: `/v3/projects/6155a8cf404647e798bd9943d7883034/users/88dc5fe8febc4f0c883f40477e3f4919/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.162187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6155a8cf404647e798bd9943d7883034, user_id=88dc5fe8febc4f0c883f40477e3f4919, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:52.165660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.198408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 910/1826] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:52 2022] PUT /identity/v3/projects/6155a8cf404647e798bd9943d7883034/users/88dc5fe8febc4f0c883f40477e3f4919/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:45:52.204593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021aa6-946b-4a0d-ab7a-96c80898dfc1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.205108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021aa6-946b-4a0d-ab7a-96c80898dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.205383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97021aa6-946b-4a0d-ab7a-96c80898dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.227483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-97021aa6-946b-4a0d-ab7a-96c80898dfc1 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:52.228767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-97021aa6-946b-4a0d-ab7a-96c80898dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:52.317690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 917/1827] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:52.328746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:52.330906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:52.403814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863aea-5c1a-4dfc-8822-6c55255dd7af admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:52.409421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:52.410265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:52.410614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:52.410878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:52.430273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:52.432272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:52.449343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 911/1828] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:53.253591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.254299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.254299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.303826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] MFA Rules not processed for user `88dc5fe8febc4f0c883f40477e3f4919`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:53.305929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:53.390166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 918/1829] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:53.395312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.409131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e88b5-c809-4a7b-a08d-5b1ad7da5b48 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.414542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.414542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.414542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.414926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.422528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.425335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.483317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 912/1830] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:45:53 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:45:53.486015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.502147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a70e96-849c-4fe1-b5e0-12765e4be71c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.591712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.592661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.593121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.593873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.594920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.598018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.647822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 919/1831] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:45:53 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:45:53.649300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.666348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217cf5b-777d-47d1-800b-32c49b9bd6b0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.672285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.673032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.673507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.674125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.674601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.676580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.684851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:53.695839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 913/1832] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:53.700013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.716364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6407-4ef9-4632-99c6-f808172859bf admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.724396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.725489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.726007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.726525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] PATH_INFO: `/v3/projects/737bfe43261a4a2898010e1db9d32024/users/181921315e8f4426bcbeb10e7b8d8252/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.731684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:53.754690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737bfe43261a4a2898010e1db9d32024, user_id=181921315e8f4426bcbeb10e7b8d8252, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.759505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.787423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 920/1833] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:53 2022] PUT /identity/v3/projects/737bfe43261a4a2898010e1db9d32024/users/181921315e8f4426bcbeb10e7b8d8252/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:53.792125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.809758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99942eb7-3072-43e9-8aec-dd495e930fd8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.928222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.931304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.931304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.932018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.932371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.935134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:53.957105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:53.958139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 914/1834] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:45:53.970088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdf1ff-b2e0-4427-9c63-0ac835accd66 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:53.977051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:53.977697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:53.977972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:53.978243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] PATH_INFO: `/v3/projects/737bfe43261a4a2898010e1db9d32024/users/181921315e8f4426bcbeb10e7b8d8252/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:53.981868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=737bfe43261a4a2898010e1db9d32024, user_id=181921315e8f4426bcbeb10e7b8d8252, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:53.984816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f55093-0f8b-46bd-9c51-2750239a796a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:54.002476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 921/1835] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:45:53 2022] PUT /identity/v3/projects/737bfe43261a4a2898010e1db9d32024/users/181921315e8f4426bcbeb10e7b8d8252/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:55.009151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.109131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e800-c8ee-4898-b0ae-95f841e952a1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.175244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:55.176180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.176500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.176816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.193366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.193926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.194518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.247044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] MFA Rules not processed for user `181921315e8f4426bcbeb10e7b8d8252`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:55.249221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:55.323879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:55.326218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143a45c-0162-4c10-8d5c-1f604aa13019 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:55.338811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 915/1836] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:55.356874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 922/1837] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:55.368263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.368545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.368820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.378660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:55.393508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] MFA Rules not processed for user `88dc5fe8febc4f0c883f40477e3f4919`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:55.394847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:55.465680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 916/1838] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:55.493308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:55.495167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:55.611287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14a11c-057f-4b0e-9948-e8fd9081b62d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:55.619970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:55.620775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:55.621452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:55.621796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:55.633794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:55.635588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434c4a6-1d6a-444b-b3e6-2e1e418c4858 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:55.647201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 923/1839] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:57.998818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:58.000610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:58.074057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077c6d3-4bcd-4ad9-aab8-1bc882ddaa15 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:58.078872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:58.079609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.079882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.080152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] PATH_INFO: `/v3/users/62cce362339f4253b43c85a1e7939d55` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.081352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cce362339f4253b43c85a1e7939d55)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:58.083304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:58.136875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cce362339f4253b43c85a1e7939d55'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:58.137910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cce362339f4253b43c85a1e7939d55'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:58.138807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cce362339f4253b43c85a1e7939d55'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:58.153408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cce362339f4253b43c85a1e7939d55'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:58.166264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cce362339f4253b43c85a1e7939d55'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:58.181471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 917/1840] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:57 2022] DELETE /identity/v3/users/62cce362339f4253b43c85a1e7939d55 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:58.186256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.186729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.186986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.208138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:45:58.209438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:58.284595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:58.324286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 924/1841] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:45:58.332095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:58.333176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:58.371104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:58.410386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0375-d3a1-4bbf-bed6-7ecb206c1e2c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:58.413795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:58.414488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.414981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.416256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.426291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:58.427907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:58.444337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 918/1842] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:45:58.907779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:58.909829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:45:58.931333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bfc91-d6b2-48ee-a120-4722da8f0caf None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:58.940249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:58.941029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:58.941244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:58.941517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] PATH_INFO: `/v3/projects/91fefc54f37a422a84556ce2b95ab74e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:58.944863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fefc54f37a422a84556ce2b95ab74e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:58.947696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.085167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fefc54f37a422a84556ce2b95ab74e', 'request_id': 'req-ec937ee7-2223-4277-88bd-63523d4d6044'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.105915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fefc54f37a422a84556ce2b95ab74e', 'request_id': 'req-ec937ee7-2223-4277-88bd-63523d4d6044'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.115429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fefc54f37a422a84556ce2b95ab74e', 'request_id': 'req-ec937ee7-2223-4277-88bd-63523d4d6044'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.128276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] The token cache is being invalidate because project 91fefc54f37a422a84556ce2b95ab74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:45:59.128595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.129302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.131698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 925/1843] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:45:58 2022] DELETE /identity/v3/projects/91fefc54f37a422a84556ce2b95ab74e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:45:59.135860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:45:59.151788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c364d-a904-487a-aeea-ab5e5c1fa4e0 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:45:59.309061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:45:59.309438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:45:59.309711 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:45:59.310170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] PATH_INFO: `/v3/users/00d61e1f457842cfbb6036ee766b92a8` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:45:59.311442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d61e1f457842cfbb6036ee766b92a8)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:45:59.313459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:45:59.428848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d61e1f457842cfbb6036ee766b92a8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.429935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d61e1f457842cfbb6036ee766b92a8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.430655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d61e1f457842cfbb6036ee766b92a8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.449364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d61e1f457842cfbb6036ee766b92a8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.459602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-03571dac-4380-417d-9306-6158175a74b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d61e1f457842cfbb6036ee766b92a8'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:45:59.478463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 919/1844] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:45:59 2022] DELETE /identity/v3/users/00d61e1f457842cfbb6036ee766b92a8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:00.064168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.066320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:00.088078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec937ee7-2223-4277-88bd-63523d4d6044 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.195913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.196654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.197039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.197381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] PATH_INFO: `/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.198606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c349044cd0b419eb2e1c1fe7aab9c83)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.201353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.291493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c349044cd0b419eb2e1c1fe7aab9c83', 'request_id': 'req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:00.307909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c349044cd0b419eb2e1c1fe7aab9c83', 'request_id': 'req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:00.329793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c349044cd0b419eb2e1c1fe7aab9c83', 'request_id': 'req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:00.338132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:00.346692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] The token cache is being invalidate because project 2c349044cd0b419eb2e1c1fe7aab9c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:00.347584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:00.348534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aa15b06a-0272-44ea-9ff6-7a78646b4a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:00.351299 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 926/1845] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:00 2022] DELETE /identity/v3/projects/2c349044cd0b419eb2e1c1fe7aab9c83 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:00.356189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.357040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.357473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.382537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:00.383903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:00.473706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:00.504158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 920/1846] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:00.519454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.519746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.520022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.540448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:00.543635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:00.559470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 927/1847] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:00.560676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.572316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bed851-d24e-4fe3-bb7f-08cf0f39eb5e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.578082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.578908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.579205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.579610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.580287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:00.580592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.583893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.604937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 921/1848] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:00.605903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.621171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebeead-53c5-4b3f-bf9f-6e589a7b314e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.628330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.628990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.629274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.629570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.631458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.633753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.665957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 928/1849] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:00 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:00.670461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.681841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d7a3-ae9d-44d3-9aed-8efefd1a612c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.758536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.759644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.759644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.760786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.761715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.766090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.814472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 922/1850] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:00 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:00.818799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.833259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6326e4-562e-4365-983e-eb20fd95a6b1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.842392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.844266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.844552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.844828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.848990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.855277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.880450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 929/1851] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:00.882245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.899461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2386-5a24-470b-a292-5e9a43552081 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.911694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.913302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.915103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.915481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.916779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.920748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53963406-1a5c-4341-9287-9707d3a8de22 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:00.940278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 923/1852] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:00.944443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:00.958034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8661ac-22e0-46ad-9a29-c408e1818785 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:00.967935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:00.968883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:00.969212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:00.969488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] PATH_INFO: `/v3/projects/25459759cb27482d8a7e61dab42e3f0d/users/160f3b17104c4030b3aa5b388e3235c4/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:00.991913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25459759cb27482d8a7e61dab42e3f0d, user_id=160f3b17104c4030b3aa5b388e3235c4, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:00.995440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.016957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 930/1853] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:00 2022] PUT /identity/v3/projects/25459759cb27482d8a7e61dab42e3f0d/users/160f3b17104c4030b3aa5b388e3235c4/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:01.034135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.034642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.037409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.072100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] MFA Rules not processed for user `160f3b17104c4030b3aa5b388e3235c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:01.073365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:01.158318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 924/1854] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:01.163529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.254260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950110-003d-477e-aed1-9b0a60e5312b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.260535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.261370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.261650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.261951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.262628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.264677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.296641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 931/1855] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:01 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:01.298363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.309894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c74c8-6542-42e9-8e34-a80fa24eda89 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.359621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:01.377426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.378048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.378323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.378586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.379222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.381644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.415566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 925/1856] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:01 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:01.416274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.437740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef21dcb-4b67-4931-a5f5-c5f74b72a97f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.443968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.444688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.445664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.446876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.447964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.449787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.469411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 932/1857] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:01.474507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.488476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93b296-5d22-4561-918a-dcba106f5584 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.494133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.494846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.495122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.495393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] PATH_INFO: `/v3/projects/b6b9e5cae4d84696843d43db95c5929a/users/a2e06643b4db4c919cf595a762a72bd9/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.512291 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b9e5cae4d84696843d43db95c5929a, user_id=a2e06643b4db4c919cf595a762a72bd9, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.515043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.536821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 926/1858] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:01 2022] PUT /identity/v3/projects/b6b9e5cae4d84696843d43db95c5929a/users/a2e06643b4db4c919cf595a762a72bd9/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:01.540879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.552315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952481-b81b-49ad-a168-8b513cbaf583 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.627861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.628893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.629219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.629504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.630600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.632061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfcb2a-45e9-41be-a224-8c328f271ce8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.649394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 933/1859] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:01.651738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.663385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c182c60-b2e6-40ef-a9f5-a01b17f13e60 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.679128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.679855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.680225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.680384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] PATH_INFO: `/v3/projects/b6b9e5cae4d84696843d43db95c5929a/users/a2e06643b4db4c919cf595a762a72bd9/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.682401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b9e5cae4d84696843d43db95c5929a, user_id=a2e06643b4db4c919cf595a762a72bd9, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.685459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:01.705735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 927/1860] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:01 2022] PUT /identity/v3/projects/b6b9e5cae4d84696843d43db95c5929a/users/a2e06643b4db4c919cf595a762a72bd9/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:01.707511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.708287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.708758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.718065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:01.757012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] MFA Rules not processed for user `a2e06643b4db4c919cf595a762a72bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:01.758551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:01.865057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 934/1861] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:01.886679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:01.889009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:01.980093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ca299-32aa-4264-b384-efc7444b93f3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:01.984033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:01.984720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:01.985162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:01.985494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:01.996022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:01.997668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.009329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 928/1862] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:02.062397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:02.065601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:02.080550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570e37-6690-4aa4-908b-e74edf1f99af None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:02.084807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:02.085603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:02.085974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:02.086457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:02.154136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:02.155584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d371bf-847f-43f7-b9be-d099ad6654ca service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:02.164865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 935/1863] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:05.908293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:05.977111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6426b-3aa1-4d39-b1fe-4243b95189d5 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:05.982100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:05.982715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:05.982990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:05.983257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] PATH_INFO: `/v3/users/160f3b17104c4030b3aa5b388e3235c4` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:05.984499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=160f3b17104c4030b3aa5b388e3235c4)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:05.986469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:06.047264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.054011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160f3b17104c4030b3aa5b388e3235c4'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.054866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160f3b17104c4030b3aa5b388e3235c4'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.055530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160f3b17104c4030b3aa5b388e3235c4'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.068588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160f3b17104c4030b3aa5b388e3235c4'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.077447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160f3b17104c4030b3aa5b388e3235c4'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.093458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 929/1864] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:05 2022] DELETE /identity/v3/users/160f3b17104c4030b3aa5b388e3235c4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:06.099911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394045-4928-40fc-92f7-054def8c9063 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:06.100436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394045-4928-40fc-92f7-054def8c9063 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:06.100531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44394045-4928-40fc-92f7-054def8c9063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:06.119775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-44394045-4928-40fc-92f7-054def8c9063 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:06.121017 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-44394045-4928-40fc-92f7-054def8c9063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:06.183873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 936/1865] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:06.194017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:06.195607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:06.278436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae437bee-7664-43c3-8aba-828c3dee6c0e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:06.282421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:06.283317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:06.283621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:06.283933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:06.297533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:06.299192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:06.315062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 930/1866] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:06.772087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394045-4928-40fc-92f7-054def8c9063 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:06.774004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-44394045-4928-40fc-92f7-054def8c9063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:06.796181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44394045-4928-40fc-92f7-054def8c9063 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:06.810295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:06.813492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:06.814521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:06.814982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] PATH_INFO: `/v3/projects/25459759cb27482d8a7e61dab42e3f0d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:06.820495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25459759cb27482d8a7e61dab42e3f0d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:06.824027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:06.894093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:06.969139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25459759cb27482d8a7e61dab42e3f0d', 'request_id': 'req-fee54f3f-b451-402e-9710-9d2c0807105d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:06.990986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25459759cb27482d8a7e61dab42e3f0d', 'request_id': 'req-fee54f3f-b451-402e-9710-9d2c0807105d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.001013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25459759cb27482d8a7e61dab42e3f0d', 'request_id': 'req-fee54f3f-b451-402e-9710-9d2c0807105d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.012737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] The token cache is being invalidate because project 25459759cb27482d8a7e61dab42e3f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:07.013698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.015583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.020268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 937/1867] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:06 2022] DELETE /identity/v3/projects/25459759cb27482d8a7e61dab42e3f0d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:07.021745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:07.032294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9378fa4-0c0c-41f4-9c37-a06a8e51232f service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:07.100442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:07.101557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.101819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.102092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] PATH_INFO: `/v3/users/a2e06643b4db4c919cf595a762a72bd9` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.103266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e06643b4db4c919cf595a762a72bd9)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:07.105653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:07.184760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e06643b4db4c919cf595a762a72bd9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.185580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e06643b4db4c919cf595a762a72bd9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.186296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e06643b4db4c919cf595a762a72bd9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.199612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:07.200653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e06643b4db4c919cf595a762a72bd9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.225627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b9746830-4519-4ce9-93e3-4956da710e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e06643b4db4c919cf595a762a72bd9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.251932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 931/1868] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:07 2022] DELETE /identity/v3/users/a2e06643b4db4c919cf595a762a72bd9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:07.536622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:07.538229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:07.560404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee54f3f-b451-402e-9710-9d2c0807105d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:07.627705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:07.628378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.628658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.628962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] PATH_INFO: `/v3/projects/b6b9e5cae4d84696843d43db95c5929a` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.630215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b9e5cae4d84696843d43db95c5929a)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:07.632094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:07.683738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b9e5cae4d84696843d43db95c5929a', 'request_id': 'req-82a66d54-3db4-413f-9769-a0126c0e99af'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.692257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b9e5cae4d84696843d43db95c5929a', 'request_id': 'req-82a66d54-3db4-413f-9769-a0126c0e99af'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.699252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b9e5cae4d84696843d43db95c5929a', 'request_id': 'req-82a66d54-3db4-413f-9769-a0126c0e99af'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.710823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] The token cache is being invalidate because project b6b9e5cae4d84696843d43db95c5929a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:07.711110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.711772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-82a66d54-3db4-413f-9769-a0126c0e99af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:07.714468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 938/1869] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:07 2022] DELETE /identity/v3/projects/b6b9e5cae4d84696843d43db95c5929a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:07.719594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.720616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.721041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.753458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:07.754710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:07.837417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 932/1870] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:07.847043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.847328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.847603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.874162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:07.875469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:07.884044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 939/1871] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:07.889151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:07.903076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaab0-e726-4e29-bd8f-71f45e98c56c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:07.909114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:07.909739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.910092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.910400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.911921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:07.912429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:07.914377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:07.932786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 933/1872] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:07.937261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:07.951292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8a05-97fb-46e1-b04d-e8c67cbcda54 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:07.967049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:07.968105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:07.968478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:07.968813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:07.969663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:07.971912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.023446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 940/1873] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:07 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:08.024630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.043983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa7da5-a502-4b0a-9b39-6ceaedfff094 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.154245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.156741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.157210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.157495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.158159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.160140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.194409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 934/1874] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:08 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:08.198638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.225243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641fd32-017d-44b0-af43-fb8125eda62a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.230531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.230750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.231179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.231457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.233389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.235664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.254666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:08.266229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 941/1875] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:08.269961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.282026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8ba7-7f04-4d57-9bc4-f30932ff1375 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.288984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.289619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.289889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.290155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.291413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.294009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d6dfa-1f41-465c-a42e-2b82170688ab admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.312271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 935/1876] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:08.318315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.333050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56044-d8ce-46d9-8f78-6e49e11f3a87 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.338662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.339344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.339626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.339897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] PATH_INFO: `/v3/projects/768442a65b00499bae0679e2c318bb79/users/c6e29fe5bc5a4eb5afe69a3ba15c8d41/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.370330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=768442a65b00499bae0679e2c318bb79, user_id=c6e29fe5bc5a4eb5afe69a3ba15c8d41, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.373085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.390105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 942/1877] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:08 2022] PUT /identity/v3/projects/768442a65b00499bae0679e2c318bb79/users/c6e29fe5bc5a4eb5afe69a3ba15c8d41/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:08.403500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.403760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.405420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.438047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] MFA Rules not processed for user `c6e29fe5bc5a4eb5afe69a3ba15c8d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:08.439612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:08.490200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:08.528044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 936/1878] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:08.533002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.597282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bab30-fe9b-443f-bb10-50f624ad61bf admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.602461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.603088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.603366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.603639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.604273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.606248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.641334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 943/1879] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:08 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:08.642768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.653869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db41240-5e96-47cd-9aa6-d929a41e5c5f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.710698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.711243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.711507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.711794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.712438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.714414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.737254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 937/1880] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:08 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:08.744157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.757731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aec94e-b1cf-47e4-88e2-bf409ac12984 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.763995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.764622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.764944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.765604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.766259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.767912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.781711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 944/1881] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:08.789074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.808402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58a18-d065-4e05-8dbc-f9f76e58ef41 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.814710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.815578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.815854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.816127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] PATH_INFO: `/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f/users/3953e8572bbb4ab78078548951abd574/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.831988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f9ab4e5e64c778c1d16a40c72a23f, user_id=3953e8572bbb4ab78078548951abd574, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.834829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.854352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 938/1882] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:08 2022] PUT /identity/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f/users/3953e8572bbb4ab78078548951abd574/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:08.855808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.866122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e869c12-77a6-4f61-abdd-63e39c656aef admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.928250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.929067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.929345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.929613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.930464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.932219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:08.952791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 945/1883] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:08.953981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:08.970717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efec2a-0764-4f90-b947-9b4bb07479bf admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:08.983675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:08.985357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:08.985639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:08.985914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] PATH_INFO: `/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f/users/3953e8572bbb4ab78078548951abd574/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:08.987983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f9ab4e5e64c778c1d16a40c72a23f, user_id=3953e8572bbb4ab78078548951abd574, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:08.997874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73df45-6a72-4d9b-b612-0bcf7f3c2e74 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:09.007929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:09.009805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.029490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f95b-6801-4850-ba92-724ad2f56abb admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:09.029838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 939/1884] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:08 2022] PUT /identity/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f/users/3953e8572bbb4ab78078548951abd574/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:09.045842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.046126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.046451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.099514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] MFA Rules not processed for user `3953e8572bbb4ab78078548951abd574`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:09.100749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.118522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:09.172735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:09.173568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.175289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.175706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] PATH_INFO: `/v3/users/77e6d83a6d80466e8507445b18b5e009` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.181405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e6d83a6d80466e8507445b18b5e009)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:09.183756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:09.281136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 940/1885] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:09.293761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:09.295543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.323468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:09.334490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e6d83a6d80466e8507445b18b5e009'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:09.335455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e6d83a6d80466e8507445b18b5e009'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:09.336056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e6d83a6d80466e8507445b18b5e009'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:09.359732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e6d83a6d80466e8507445b18b5e009'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:09.371287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dfe4ee9a-76fa-487d-b0a7-2bb12bedfb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e6d83a6d80466e8507445b18b5e009'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:09.394883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 946/1886] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:09 2022] DELETE /identity/v3/users/77e6d83a6d80466e8507445b18b5e009 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:09.401055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.401557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.401794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.402533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f589-a181-4dea-90f1-ca400f8dab65 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:09.427726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:09.430075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.475952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:09.476510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.476790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.477096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.481674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.526925 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 947/1887] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:09.540370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:09.542115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.580107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:09.601908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:09.630713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 941/1888] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:09.630934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c633d0f-b28e-4ca1-9048-123ad3deb411 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:09.634888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:09.635285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.635562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.635832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.648177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:09.650477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:09.665652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 948/1889] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:09.759029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:09.760531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.776154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0696d6f-a993-4664-91c9-0e0be179607e service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:09.780955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:09.781846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:09.782132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:09.782592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:09.784758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:09.867247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:09.869655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:09.882625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 942/1890] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:10.187369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:10.188809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:10.222578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a4cc2-ffb3-46cf-ba6a-e19927dc78bd service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:10.228522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:10.229278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.229622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.229964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] PATH_INFO: `/v3/projects/b3acd68931a04b348dd3a415a1709f7e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.231320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3acd68931a04b348dd3a415a1709f7e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:10.234117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:10.237170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:10.304178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3acd68931a04b348dd3a415a1709f7e', 'request_id': 'req-88cabac2-5dda-4122-b5bb-e037fa754f4d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.318507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3acd68931a04b348dd3a415a1709f7e', 'request_id': 'req-88cabac2-5dda-4122-b5bb-e037fa754f4d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.333103 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3acd68931a04b348dd3a415a1709f7e', 'request_id': 'req-88cabac2-5dda-4122-b5bb-e037fa754f4d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.347349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] The token cache is being invalidate because project b3acd68931a04b348dd3a415a1709f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:10.348342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.349326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.351006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 949/1891] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:10 2022] DELETE /identity/v3/projects/b3acd68931a04b348dd3a415a1709f7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:10.355381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:10.368131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af5c89-e930-4b12-905a-ec548840653b service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:10.395612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:10.449544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:10.450240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:10.450509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:10.450772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] PATH_INFO: `/v3/users/e4c05d1a8ad5406bb320dc175d29871c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:10.451939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c05d1a8ad5406bb320dc175d29871c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:10.454029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:10.520157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c05d1a8ad5406bb320dc175d29871c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.521083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c05d1a8ad5406bb320dc175d29871c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.521756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c05d1a8ad5406bb320dc175d29871c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.538321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c05d1a8ad5406bb320dc175d29871c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.550653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4466a2a4-cd70-44c8-8284-b4f70c10e305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c05d1a8ad5406bb320dc175d29871c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:10.567215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 943/1892] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:10 2022] DELETE /identity/v3/users/e4c05d1a8ad5406bb320dc175d29871c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:10.988229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:10.993947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:11.017443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cabac2-5dda-4122-b5bb-e037fa754f4d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.094211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.095272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.095639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.096006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] PATH_INFO: `/v3/projects/3bfbfd8978664444ad2f9bd4c831e669` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.097451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfbfd8978664444ad2f9bd4c831e669)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.104451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.176210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfbfd8978664444ad2f9bd4c831e669', 'request_id': 'req-245b0afb-a947-46b9-a14c-4d6b577b25fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:11.186521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfbfd8978664444ad2f9bd4c831e669', 'request_id': 'req-245b0afb-a947-46b9-a14c-4d6b577b25fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:11.194445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfbfd8978664444ad2f9bd4c831e669', 'request_id': 'req-245b0afb-a947-46b9-a14c-4d6b577b25fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:11.207592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] The token cache is being invalidate because project 3bfbfd8978664444ad2f9bd4c831e669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:11.207883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:11.208539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-245b0afb-a947-46b9-a14c-4d6b577b25fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:11.212494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 950/1893] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:10 2022] DELETE /identity/v3/projects/3bfbfd8978664444ad2f9bd4c831e669 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:11.223582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.223840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.228026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.251003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:11.252427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:11.339349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 944/1894] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:11.348689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.349033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.349499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.375012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:11.376693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:11.426869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.432338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 951/1895] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:11.438772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ae56e-5ba1-432d-bc5f-1a73ddc937be None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.444497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.445164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.445739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.446222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.446702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:11.446977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.448817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.465668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 945/1896] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:11.467152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.476780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cfd23-0c31-4216-8e30-17cb26c92169 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.487873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.488512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.488941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.489086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.489754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.491703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.508308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:11.531610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 952/1897] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:11.533134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.544430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493f24-a24e-4a66-9d86-fd7e09127abc admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.567516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:11.613952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.614626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.614859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.615130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.615768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.617839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.641132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 946/1898] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:11.645409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.655969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11d45-cfc7-43b6-8f91-104d0b4a9eb7 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.660694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.661348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.661619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.661890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.662538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.664380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.676289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 953/1899] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:11.680510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.693916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15cc7-3a3d-47b7-bc0f-a76b757bf948 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.698853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.699477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.699754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.700068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.700724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.702490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71013bf5-8567-46c5-93a5-1548d8f3092b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.715517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 947/1900] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:11.720161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.736160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f237b35-7206-4c56-b19a-874d19f545d6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.742214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.743891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.743891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.744101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] PATH_INFO: `/v3/projects/42378c9285304bc5a4f1b7bb9033ccf1/users/50b888d0cb6e4a508df03049bf1c3e0b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.763199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] RBAC: Authorizing `identity:create_grant(project_id=42378c9285304bc5a4f1b7bb9033ccf1, user_id=50b888d0cb6e4a508df03049bf1c3e0b, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:11.766693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:11.785502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 954/1901] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:11 2022] PUT /identity/v3/projects/42378c9285304bc5a4f1b7bb9033ccf1/users/50b888d0cb6e4a508df03049bf1c3e0b/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:11.797539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.797812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.798122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.841508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] MFA Rules not processed for user `50b888d0cb6e4a508df03049bf1c3e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:11.842807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:11.915501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 948/1902] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:11.920167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:11.989881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bbf09-ee76-4985-8538-73c9f7b5cede admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:11.996011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:11.996667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:11.996971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:11.997414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:11.998254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.000595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.034333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 955/1903] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:12.037055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.055619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384f02-2200-4d03-a5db-e77a11e4d470 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.132920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.133610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.133888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.134158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.134813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.136804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.200307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 949/1904] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:12 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:12.204522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.216168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216fe3d-d399-425e-b07b-374cd16215c4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.235841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.238323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.238774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.239199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.247784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.252377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.279213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 956/1905] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:12.283985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.295957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93936a39-1ea8-48dc-92a1-4da633eaa3fb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.300636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.301373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.301654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.301929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] PATH_INFO: `/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9/users/855fbbc05b3346fb8470db80b3971e94/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.319351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd480b0a7ca24f12a017a15d9887b8b9, user_id=855fbbc05b3346fb8470db80b3971e94, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.322159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.332237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:12.340304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 950/1906] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:12 2022] PUT /identity/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9/users/855fbbc05b3346fb8470db80b3971e94/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:12.346180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.359833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b9d2-68b3-496b-803a-abcd3c7bbd2d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.422179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.422817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.423091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.423359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.436078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.436078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df66161-4d09-400f-aa71-c6e2895742f0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.436078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 957/1907] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:12.440237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.450630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212ee4-1d15-4061-a394-15b6be305896 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.455235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.455891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.456166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.456437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] PATH_INFO: `/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9/users/855fbbc05b3346fb8470db80b3971e94/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.458424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd480b0a7ca24f12a017a15d9887b8b9, user_id=855fbbc05b3346fb8470db80b3971e94, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.461191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.471985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 951/1908] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:12 2022] PUT /identity/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9/users/855fbbc05b3346fb8470db80b3971e94/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:12.482342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.482628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.482905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.511631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] MFA Rules not processed for user `855fbbc05b3346fb8470db80b3971e94`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:12.512830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:12.530192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:12.585256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 958/1909] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:12.596872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.598756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:12.674278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.675709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:12.713165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f2043-0f89-478c-a915-068196cc7f50 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.717574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.718232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.718512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.718954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.730080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.731548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.745617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 952/1910] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:12.790199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8f38-61d7-44b2-8ac4-a0e6c69ebfa1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.797296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.798458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.798928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.799082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] PATH_INFO: `/v3/users/c6e29fe5bc5a4eb5afe69a3ba15c8d41` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.802927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e29fe5bc5a4eb5afe69a3ba15c8d41)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.806347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.848277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:12.866332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c1b6c-6ace-42a0-b09e-bd779a974b67 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:12.873487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:12.874276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.875407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.875407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] PATH_INFO: `/v3/users/50b888d0cb6e4a508df03049bf1c3e0b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.876154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b888d0cb6e4a508df03049bf1c3e0b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:12.892687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:12.908689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e29fe5bc5a4eb5afe69a3ba15c8d41'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:12.909883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e29fe5bc5a4eb5afe69a3ba15c8d41'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:12.910576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e29fe5bc5a4eb5afe69a3ba15c8d41'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:12.927306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e29fe5bc5a4eb5afe69a3ba15c8d41'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:12.936858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc7869f9-8b0d-4f41-872f-c794da03d7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e29fe5bc5a4eb5afe69a3ba15c8d41'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:12.963699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 959/1911] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:12 2022] DELETE /identity/v3/users/c6e29fe5bc5a4eb5afe69a3ba15c8d41 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:12.966132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:12.966502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:12.967326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:12.989094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:12.990373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:13.000424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b888d0cb6e4a508df03049bf1c3e0b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:13.001244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b888d0cb6e4a508df03049bf1c3e0b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:13.001985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b888d0cb6e4a508df03049bf1c3e0b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:13.017136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b888d0cb6e4a508df03049bf1c3e0b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:13.028253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:13.031629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bc8374b3-9b50-4061-89be-18d7df907b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b888d0cb6e4a508df03049bf1c3e0b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:13.058184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 953/1912] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:12 2022] DELETE /identity/v3/users/50b888d0cb6e4a508df03049bf1c3e0b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:13.066731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.067012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.067275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.071789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 960/1913] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:13.083670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:13.085468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:13.093508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:13.095149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:13.163084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:13.174572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 954/1914] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:13.178744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a8b99-1940-4eae-9093-83d51db2e5a3 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:13.195493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:13.262520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:13.263823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.264129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.264544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.272774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b015-3a8f-4c86-a3ca-f639b6c57a96 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:13.276380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:13.277558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:13.278133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:13.278247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.278448 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.278719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.294332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 961/1915] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:13.296969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:13.298895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:13.316704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 955/1916] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:13.927725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:13.930748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:13.953655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd687f8c-de4f-40cc-a462-d7c9ab5ecc32 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:13.958558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:13.959357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:13.959636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:13.959905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] PATH_INFO: `/v3/projects/768442a65b00499bae0679e2c318bb79` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:13.961064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=768442a65b00499bae0679e2c318bb79)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:13.963086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:14.040034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768442a65b00499bae0679e2c318bb79', 'request_id': 'req-e3914e3c-1cb6-4223-8884-6c728a6dd93c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.051121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768442a65b00499bae0679e2c318bb79', 'request_id': 'req-e3914e3c-1cb6-4223-8884-6c728a6dd93c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.058451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:14.060579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:14.067785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768442a65b00499bae0679e2c318bb79', 'request_id': 'req-e3914e3c-1cb6-4223-8884-6c728a6dd93c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.081424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ed28-3a59-46a6-9a77-39a4b99d6da9 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:14.090882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] The token cache is being invalidate because project 768442a65b00499bae0679e2c318bb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:14.091173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.092322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.097660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 962/1917] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:13 2022] DELETE /identity/v3/projects/768442a65b00499bae0679e2c318bb79 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:14.099130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:14.101324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:14.121872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:14.161795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:14.162706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:14.162706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:14.162933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] PATH_INFO: `/v3/projects/42378c9285304bc5a4f1b7bb9033ccf1` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:14.164240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=42378c9285304bc5a4f1b7bb9033ccf1)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:14.166876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:14.188381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3914e3c-1cb6-4223-8884-6c728a6dd93c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:14.196753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:14.197519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:14.197936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:14.198271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] PATH_INFO: `/v3/users/3953e8572bbb4ab78078548951abd574` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:14.199760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3953e8572bbb4ab78078548951abd574)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:14.202261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:14.225869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42378c9285304bc5a4f1b7bb9033ccf1', 'request_id': 'req-c205f541-959a-4e55-b90b-2ab10d917bae'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.239329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42378c9285304bc5a4f1b7bb9033ccf1', 'request_id': 'req-c205f541-959a-4e55-b90b-2ab10d917bae'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.247900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42378c9285304bc5a4f1b7bb9033ccf1', 'request_id': 'req-c205f541-959a-4e55-b90b-2ab10d917bae'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.267526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] The token cache is being invalidate because project 42378c9285304bc5a4f1b7bb9033ccf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:14.267869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.268559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.270211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 956/1918] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:14 2022] DELETE /identity/v3/projects/42378c9285304bc5a4f1b7bb9033ccf1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:14.274474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:14.275868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:14.284524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3953e8572bbb4ab78078548951abd574'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.285873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3953e8572bbb4ab78078548951abd574'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.286522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3953e8572bbb4ab78078548951abd574'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.303514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3953e8572bbb4ab78078548951abd574'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.310236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3953e8572bbb4ab78078548951abd574'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.331806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 963/1919] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:14 2022] DELETE /identity/v3/users/3953e8572bbb4ab78078548951abd574 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:14.338699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:14.382635 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f541-959a-4e55-b90b-2ab10d917bae admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:14.473755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:14.474572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:14.475015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:14.475361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] PATH_INFO: `/v3/users/855fbbc05b3346fb8470db80b3971e94` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:14.476921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855fbbc05b3346fb8470db80b3971e94)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:14.479408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:14.556005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855fbbc05b3346fb8470db80b3971e94'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.557036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855fbbc05b3346fb8470db80b3971e94'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.557973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855fbbc05b3346fb8470db80b3971e94'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.576671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855fbbc05b3346fb8470db80b3971e94'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.586925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8ee066ca-a1aa-4145-ae4b-8de1ca45fc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855fbbc05b3346fb8470db80b3971e94'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.603371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 957/1920] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:14 2022] DELETE /identity/v3/users/855fbbc05b3346fb8470db80b3971e94 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:14.738057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:14.740073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:14.777448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ae065-d3a2-4ca3-b601-23744160fb08 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:14.850376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:14.851050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:14.851359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:14.851643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] PATH_INFO: `/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:14.852787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74f9ab4e5e64c778c1d16a40c72a23f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:14.854760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:14.902760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:14.915918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74f9ab4e5e64c778c1d16a40c72a23f', 'request_id': 'req-8cb74edd-36dd-4a25-b5f6-4378a4547571'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.927684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74f9ab4e5e64c778c1d16a40c72a23f', 'request_id': 'req-8cb74edd-36dd-4a25-b5f6-4378a4547571'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.936437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74f9ab4e5e64c778c1d16a40c72a23f', 'request_id': 'req-8cb74edd-36dd-4a25-b5f6-4378a4547571'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.949910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] The token cache is being invalidate because project a74f9ab4e5e64c778c1d16a40c72a23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:14.950148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.951124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8cb74edd-36dd-4a25-b5f6-4378a4547571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:14.953001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 964/1921] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:14 2022] DELETE /identity/v3/projects/a74f9ab4e5e64c778c1d16a40c72a23f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:14.958436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:14.958436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:14.958758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:14.979937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:14.981993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.041752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:15.057538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 958/1922] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:15.059276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.059745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.059833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.091694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:15.093008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.100837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 965/1923] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:15.105383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.115305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad97af-510b-427b-9e19-b6011f59f05c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.120052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.120663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.120976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.121243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.121885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:15.122179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.123781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.136084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 959/1924] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:15.141413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.151328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fcb92-821a-444d-937e-4fa438bf38b6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.156582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.157230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.157586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.157856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.158509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.160478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.194353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 966/1925] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:15.198831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.211574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed616a-016f-4865-a33b-715e23c63a21 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.278086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.278709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.278991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.279277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.279923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.282006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.305552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 960/1926] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:15.310173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.321230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60aee1-756e-4299-b5e6-3d48213a3923 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.326463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.327084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.327473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.327722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.328364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.330078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.344002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 967/1927] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:15.345575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.359115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38102-6129-48e3-bb16-817d31bd9e64 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.364389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.365098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.365389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.365865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.366512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.368136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.383531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.386127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 961/1928] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:15.386635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.387023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.397493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f29ed6-fcd0-455b-81e9-635db2c8d097 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.404954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeefaba-7166-4454-a595-4b76c5ce56d0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.407981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.408835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.409192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.409614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] PATH_INFO: `/v3/projects/0ebbe5b44ae2414cbf2ccf948e001551/users/3fd3cb95ffd14d0b8d401fac6b6787fe/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.415330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.416231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.416848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.417425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] PATH_INFO: `/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.418712 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd480b0a7ca24f12a017a15d9887b8b9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.420782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.460347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebbe5b44ae2414cbf2ccf948e001551, user_id=3fd3cb95ffd14d0b8d401fac6b6787fe, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.463098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b117-8cb0-44af-ab31-56e4d41694b3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.484175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 962/1929] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:15 2022] PUT /identity/v3/projects/0ebbe5b44ae2414cbf2ccf948e001551/users/3fd3cb95ffd14d0b8d401fac6b6787fe/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:15.496158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.496467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.496714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.509043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd480b0a7ca24f12a017a15d9887b8b9', 'request_id': 'req-c399786c-7bd1-4cfe-8493-45b9bb90a28b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:15.519394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd480b0a7ca24f12a017a15d9887b8b9', 'request_id': 'req-c399786c-7bd1-4cfe-8493-45b9bb90a28b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:15.527639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd480b0a7ca24f12a017a15d9887b8b9', 'request_id': 'req-c399786c-7bd1-4cfe-8493-45b9bb90a28b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:15.530362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] MFA Rules not processed for user `3fd3cb95ffd14d0b8d401fac6b6787fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:15.531700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.540436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] The token cache is being invalidate because project fd480b0a7ca24f12a017a15d9887b8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:15.540436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:15.541192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c399786c-7bd1-4cfe-8493-45b9bb90a28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:15.544083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 968/1930] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:15 2022] DELETE /identity/v3/projects/fd480b0a7ca24f12a017a15d9887b8b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:15.549697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815dda2-f86a-4bf0-a109-a45d132ee755 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.550083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815dda2-f86a-4bf0-a109-a45d132ee755 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.550505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815dda2-f86a-4bf0-a109-a45d132ee755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.579171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4815dda2-f86a-4bf0-a109-a45d132ee755 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:15.580469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4815dda2-f86a-4bf0-a109-a45d132ee755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.617520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 963/1931] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:15.632655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.634637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.678146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 969/1932] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:15.680473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.680812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.681153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.682016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:15.735455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:15.736702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.757176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 970/1933] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:15.761655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.767088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:15.767698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a4e0f-a764-4af4-8935-51fb723f1f9d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.773766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.774336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.774672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.774939 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.787139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.790540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.793231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba6db1-c76a-459c-aba1-8ecfc051d4ef None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.805324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 964/1934] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:15.817866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.820955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.821796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.822362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.822780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.823611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.823901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:15.824358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.828661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.864396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 971/1935] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:15.865852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:15.883193 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2519f-bd08-4a94-a6d9-0d0224577fc8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.893596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.894239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.894520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.894789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.895433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:15.897942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:15.944639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8cb21-6273-4afe-80d5-fd6578e8d250 service glance] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:15.950642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:15.952019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:15.952430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:15.952967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:15.955757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:15.965944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 972/1936] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:15.973955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.080374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.082011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.093657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 965/1937] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:16.098197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db916a8-c48e-493f-a7ea-25d418318d6f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.108394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.109090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.109429 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.109703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.110331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.112262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.147393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 973/1938] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:15 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:16.151280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.165558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b29301-6842-405e-8d1b-68159251b894 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.173687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.174359 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.175058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.176102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.176866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.179659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.196460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 966/1939] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:16.201496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.223527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32bcaf-34b9-4338-a852-884e3dce5e8f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.235354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.236002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.236280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.236557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.237309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.239233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3015ca1-cedf-4aad-a41e-5e79ff57d727 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.257143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.264626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 974/1940] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:16.269856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11539cb-b76f-4312-a5f1-3c28d3d26cd9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.276109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.276968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.277390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.277958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] PATH_INFO: `/v3/projects/7a6f92ba65164884917c1bde0c9b7733/users/061d84a8a8484405af8aa3fcfb961a6d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.302178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6f92ba65164884917c1bde0c9b7733, user_id=061d84a8a8484405af8aa3fcfb961a6d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.305454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.325262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 967/1941] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:16 2022] PUT /identity/v3/projects/7a6f92ba65164884917c1bde0c9b7733/users/061d84a8a8484405af8aa3fcfb961a6d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:16.336716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d342ab-21f4-4930-9594-32b348353866 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.338215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d342ab-21f4-4930-9594-32b348353866 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.338599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d342ab-21f4-4930-9594-32b348353866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.408053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-35d342ab-21f4-4930-9594-32b348353866 None None] MFA Rules not processed for user `061d84a8a8484405af8aa3fcfb961a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:16.409201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-35d342ab-21f4-4930-9594-32b348353866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:16.498312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 975/1942] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:16.502930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.578226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.634248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9465-8318-43f5-9a52-acca5daf2365 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.639585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.640572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.641558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.641558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.642034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.644405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.680967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 968/1943] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:16 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:16.685051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d342ab-21f4-4930-9594-32b348353866 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.699063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d342ab-21f4-4930-9594-32b348353866 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.742492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:16.774272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.774909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.775183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.775450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.776085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.778453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.829213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 976/1944] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:16 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:16.833566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.848866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e1bc3-2715-4a58-81eb-483e27786ac0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.864289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.865219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.865413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.868987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.868987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.868987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.898051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 969/1945] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:16.899231 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.923951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff08625-0d89-4a6a-9eb2-85968a573956 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.932654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.933420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.933619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.933873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.934540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.936545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eecfa4-6601-48f2-a339-e29a5e7836a3 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:16.949467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 977/1946] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:16.953855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:16.965377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893b895-36ef-44b2-a9a7-a560734997ce admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:16.973116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:16.974351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:16.974902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:16.975329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] PATH_INFO: `/v3/projects/0530a7155d5145d58aae01998f339394/users/edf6f810a62045e6ab103bc58301e27f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:16.995433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0530a7155d5145d58aae01998f339394, user_id=edf6f810a62045e6ab103bc58301e27f, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:16.999281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.029799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 970/1947] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:16 2022] PUT /identity/v3/projects/0530a7155d5145d58aae01998f339394/users/edf6f810a62045e6ab103bc58301e27f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:17.041180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.041857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.042397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.075717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] MFA Rules not processed for user `edf6f810a62045e6ab103bc58301e27f`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:17.077440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:17.190340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 978/1948] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:17.195126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.294029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fd93-9de8-4104-a3c2-331f7394a3b4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.302744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.303462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.303807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.304226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.306038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.307163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.348331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 971/1949] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:17 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:17.350560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.362244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79fa55-9c5e-4f2b-9d78-d5c7bb68edac None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.431294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.431950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.432228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.432495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.433191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.435567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.457408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 979/1950] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:17 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:17.461716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.476262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d57fe3-dae1-411c-8db4-0e9c58801843 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.481723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.482539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.482822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.483105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.483758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.485476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.498613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 972/1951] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:17.504523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.517669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94386d3d-f4e7-4f7b-9af6-a0f1686e9319 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.523629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.524432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.524772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.525154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] PATH_INFO: `/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0/users/5bd580b7ac934a27a5cfa10036da4180/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.552454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c02e1786ff4cc38fc9f8126df365e0, user_id=5bd580b7ac934a27a5cfa10036da4180, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.556960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.590273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 980/1952] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:17 2022] PUT /identity/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0/users/5bd580b7ac934a27a5cfa10036da4180/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:17.605057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.622580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c46f6-31b8-4ef2-9bb2-8387a4f59e12 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.689812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:17.701545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.702271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.702553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.702826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.703503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.705149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e716a-51f0-409b-89c9-3c266947e9e4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.716430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 973/1953] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:17.721034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.732622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497be543-887b-437d-8f27-ce705110f5e9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.737496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.738240 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.738586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.738923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] PATH_INFO: `/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0/users/5bd580b7ac934a27a5cfa10036da4180/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.740960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c02e1786ff4cc38fc9f8126df365e0, user_id=5bd580b7ac934a27a5cfa10036da4180, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.743727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:17.747046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:17.756606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 981/1954] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:17 2022] PUT /identity/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0/users/5bd580b7ac934a27a5cfa10036da4180/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:17.768132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c32f-40e1-41e2-9b64-36f149387d66 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.768440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c32f-40e1-41e2-9b64-36f149387d66 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.768694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c32f-40e1-41e2-9b64-36f149387d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.799690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c815c32f-40e1-41e2-9b64-36f149387d66 None None] MFA Rules not processed for user `5bd580b7ac934a27a5cfa10036da4180`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:17.801031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c815c32f-40e1-41e2-9b64-36f149387d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:17.881273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 974/1955] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:17.892984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:17.894861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:17.970199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69bd53-c3d7-44fc-9405-0abafc35012b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:17.974186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:17.974831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:17.975097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:17.975947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:17.987110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:17.991008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc830cf-985b-4a94-8273-17dc15e89988 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:18.004972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 982/1956] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:18.621373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:18.621945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:18.621945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:18.625802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 975/1957] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:46:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:18.642483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:18.643006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:18.643006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:18.675994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:18.681890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:18.734379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:18.736069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:18.789221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 983/1958] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:18.790257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:18.802108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b886f-cf1b-4ca3-ace6-2c2eeda8572f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:18.818265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:18.819209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:18.819481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:18.819807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:18.845838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2636313-63d7-4c9b-b55e-1f9d82ea41ca None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:18.851248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:18.851913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:18.852188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:18.852456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] PATH_INFO: `/v3/users/7351cbc020324833b9bb1f8558a93f02` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:18.853790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7351cbc020324833b9bb1f8558a93f02)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:18.858759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:18.885673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:18.887180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:18.913270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 984/1959] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:18.915452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:18.918963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:18.926953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7351cbc020324833b9bb1f8558a93f02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:18.927646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7351cbc020324833b9bb1f8558a93f02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:18.928440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7351cbc020324833b9bb1f8558a93f02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:18.942269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7351cbc020324833b9bb1f8558a93f02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:18.951579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef4c6-cd5e-4122-ac0b-7ba0d7d396a6 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:18.954468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7351cbc020324833b9bb1f8558a93f02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:18.958314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:18.959031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:18.959466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:18.959981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:18.960651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:18.962804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:18.970461 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 976/1960] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:18 2022] DELETE /identity/v3/users/7351cbc020324833b9bb1f8558a93f02 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:18.980601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:18.982426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc348d-59a7-4a9d-9623-75f035d79414 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:18.993174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 985/1961] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:19.175393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.177608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:19.274590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8050ab-33a6-44dc-a253-111a1b3b631a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.280173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.280850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.281178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.281402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] PATH_INFO: `/v3/projects/7b064e76960a4e6190919add5957ad42` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.282658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b064e76960a4e6190919add5957ad42)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.284624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.341267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b064e76960a4e6190919add5957ad42', 'request_id': 'req-870635c5-6400-4a48-828f-eb8691c0023d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:19.350137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b064e76960a4e6190919add5957ad42', 'request_id': 'req-870635c5-6400-4a48-828f-eb8691c0023d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:19.356914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b064e76960a4e6190919add5957ad42', 'request_id': 'req-870635c5-6400-4a48-828f-eb8691c0023d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:19.367999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] The token cache is being invalidate because project 7b064e76960a4e6190919add5957ad42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:19.368284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:19.368958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-870635c5-6400-4a48-828f-eb8691c0023d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:19.370469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 977/1962] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:19 2022] DELETE /identity/v3/projects/7b064e76960a4e6190919add5957ad42 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:19.375662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.375933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.376207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.397966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:19.399199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:19.412547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:19.466499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 986/1963] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:19.475656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.475934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.476201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.496519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:19.497748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:19.506618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 978/1964] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:19.511079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.521731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b32568-1a88-4629-9b80-73d5ec874311 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.542632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.543287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.543564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.543831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.544515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:19.544950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.546758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.567424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 987/1965] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:19.569101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.578904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089a9f-95ad-4006-80aa-1f98f8ca1874 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.583760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.584154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.584418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.584702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.585623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.587401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.628444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 979/1966] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:19.629854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.647161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ff37a-6dfd-40c5-a971-928cf7f332df admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.713069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.714361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.714801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.715113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.715826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.718041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.745114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 988/1967] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:19.749191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.759705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec51-5e11-4cc8-88e1-3c71ecf47c5f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.764320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.765017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.765829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.766109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.766757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.768370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.783255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 980/1968] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:19.785087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.795650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795d1c9-44a4-4f1f-932a-08642c889b59 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.802205 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.802879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.803269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.803543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.804243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.806100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d03ae9-5b3d-4840-93a3-f4f6e2ef1491 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.821134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 989/1969] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:19.822521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:19.834433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e325c-6410-4f28-a19c-f8edb27b3e2c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:19.840433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:19.841164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.841591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.841879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] PATH_INFO: `/v3/projects/751269f980ad4dcda14fddff7ad739cb/users/f83a315db302484ab2c9965444354dc7/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.874517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751269f980ad4dcda14fddff7ad739cb, user_id=f83a315db302484ab2c9965444354dc7, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:19.877863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:19.893117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 981/1970] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:19 2022] PUT /identity/v3/projects/751269f980ad4dcda14fddff7ad739cb/users/f83a315db302484ab2c9965444354dc7/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:19.904817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:19.905137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:19.905476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:19.942681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] MFA Rules not processed for user `f83a315db302484ab2c9965444354dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:19.944260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:20.025190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 990/1971] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:20.036329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:20.038087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:20.070625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:20.127476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d91b-d682-4bc1-b551-0d2c112b81e5 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:20.133154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:20.133771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:20.134044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:20.134314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:20.142747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:20.144706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:20.155251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 982/1972] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:23.188725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:23.190225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:23.209256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:23.255862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77388c0-0d33-4297-ae89-c91c534579a9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:23.260759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:23.261589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:23.261989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:23.262268 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:23.264149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:23.336755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:23.338177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:23.347294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 991/1973] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:25.478134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:25.550379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f1dd0-bf77-4150-9ae6-94e4251b9626 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:25.556733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:25.557463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.557741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.558011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] PATH_INFO: `/v3/users/f83a315db302484ab2c9965444354dc7` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.560253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83a315db302484ab2c9965444354dc7)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:25.561562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:25.611005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:25.612276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83a315db302484ab2c9965444354dc7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.612483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:25.612979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83a315db302484ab2c9965444354dc7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.613681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83a315db302484ab2c9965444354dc7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.627978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf277d-7b0b-4ab1-bb88-3de1ad9dd046 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:25.630986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83a315db302484ab2c9965444354dc7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.632684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:25.633397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.633678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.633967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] PATH_INFO: `/v3/users/061d84a8a8484405af8aa3fcfb961a6d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.635070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=061d84a8a8484405af8aa3fcfb961a6d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:25.637132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:25.640758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f3dded0-0009-460f-b3c0-6e918e7700fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83a315db302484ab2c9965444354dc7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.654153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 983/1974] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:25 2022] DELETE /identity/v3/users/f83a315db302484ab2c9965444354dc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:25.658772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.659056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.659330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.680138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:25.681547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:25.694641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061d84a8a8484405af8aa3fcfb961a6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.695354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061d84a8a8484405af8aa3fcfb961a6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.696042 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061d84a8a8484405af8aa3fcfb961a6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.701432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:25.708883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061d84a8a8484405af8aa3fcfb961a6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.716206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-924b8e8b-b491-4248-99ae-dce013cab3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061d84a8a8484405af8aa3fcfb961a6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:25.730700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 992/1975] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:25 2022] DELETE /identity/v3/users/061d84a8a8484405af8aa3fcfb961a6d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:25.735348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.735633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.735911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.747681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 984/1976] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:25.755633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:25.757203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:25.757526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:25.759187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:25.796589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:25.819077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56ce4-ebd2-42e8-ad84-313deae2d60a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:25.821691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 993/1977] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:25.831829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:25.876781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:25.877475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.877753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.878025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.888454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:25.889961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:25.894297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154c3c-88cb-49b4-ac84-902d8cff0405 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:25.898521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:25.899154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:25.899427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:25.899833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:25.900203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 985/1978] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:25.914101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:25.915464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:25.927079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 994/1979] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:26.301764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.302867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.343716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74541c2-d29d-433c-a24e-350dcc619bd6 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.354825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.356221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.356221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.356221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] PATH_INFO: `/v3/projects/751269f980ad4dcda14fddff7ad739cb` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.357319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=751269f980ad4dcda14fddff7ad739cb)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.359447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.387591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.389060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.407345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a33a-bed4-4977-8c0c-cadbb5b10f43 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.416144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.417158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.417445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.417809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] PATH_INFO: `/v3/projects/7a6f92ba65164884917c1bde0c9b7733` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.421060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6f92ba65164884917c1bde0c9b7733)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.427173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.429880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751269f980ad4dcda14fddff7ad739cb', 'request_id': 'req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.444753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751269f980ad4dcda14fddff7ad739cb', 'request_id': 'req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.451672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751269f980ad4dcda14fddff7ad739cb', 'request_id': 'req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.465981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] The token cache is being invalidate because project 751269f980ad4dcda14fddff7ad739cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:26.467168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.468215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fc71b3c7-1c3f-46f3-a1fc-a891a54bb50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.470264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 986/1980] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:26 2022] DELETE /identity/v3/projects/751269f980ad4dcda14fddff7ad739cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:26.475287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834bea8-527d-486e-9226-b3df22a40661 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.475611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834bea8-527d-486e-9226-b3df22a40661 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.475877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834bea8-527d-486e-9226-b3df22a40661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.491739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:26.498616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c834bea8-527d-486e-9226-b3df22a40661 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:26.501279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c834bea8-527d-486e-9226-b3df22a40661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.503373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6f92ba65164884917c1bde0c9b7733', 'request_id': 'req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.511194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6f92ba65164884917c1bde0c9b7733', 'request_id': 'req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.519989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6f92ba65164884917c1bde0c9b7733', 'request_id': 'req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.536987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] The token cache is being invalidate because project 7a6f92ba65164884917c1bde0c9b7733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:26.537289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.537969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.544024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 995/1981] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:26 2022] DELETE /identity/v3/projects/7a6f92ba65164884917c1bde0c9b7733 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:26.547949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.549677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.596875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 987/1982] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:26.604804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.605038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.605301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.628207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:26.629460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.633834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb649e2-db27-44d3-8c8a-179f9fa2fc2c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.638758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 988/1983] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:26.639728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.640809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.641121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.641403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] PATH_INFO: `/v3/users/edf6f810a62045e6ab103bc58301e27f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.642697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf6f810a62045e6ab103bc58301e27f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.643296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.645195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.653106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da7503-2b24-4e1a-969e-e5111f1f7efb None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.657537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:26.658326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.659019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.659299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.659571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.660235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:26.660544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.662247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.677681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 989/1984] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:26.681969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.692214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc330-e7ce-4a16-9ff1-098b624c622e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.697453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.698056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.698335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.698608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.698707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf6f810a62045e6ab103bc58301e27f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.699237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.699354 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf6f810a62045e6ab103bc58301e27f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.699923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf6f810a62045e6ab103bc58301e27f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.701260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.712173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf6f810a62045e6ab103bc58301e27f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.719100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf6f810a62045e6ab103bc58301e27f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:26.736081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 990/1985] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:26 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:26.736261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 996/1986] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:26 2022] DELETE /identity/v3/users/edf6f810a62045e6ab103bc58301e27f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:26.737256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.738977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:26.818831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33835-7e1b-4ea6-ba78-a6a56e9bf13e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.878286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.878921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.879274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.879654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.880395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.882572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.914063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 991/1987] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:26 2022] POST /identity/v3/users => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:26.915916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.931556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab3da-eddb-40ab-b505-ad3adc9da6f8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.937322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.937953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.938228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.938496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.939152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.940808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.954284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 997/1988] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:26.955729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:26.961135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:26.968075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b4c2-213b-4c3b-8e2f-82460aedb440 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:26.974379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:26.975079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:26.975355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:26.975624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:26.976388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:26.977914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:26.991322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 992/1989] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:26.992867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.003702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09deb1-b7d2-4e5f-98ed-203433a7eed5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.008924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.009603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.010018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.010293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] PATH_INFO: `/v3/projects/e4904ee81cf34cf780bc90c7bdbb44d9/users/621780ee9f5e45b3a1694b261cc36ebb/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.021455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.023660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.030442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4904ee81cf34cf780bc90c7bdbb44d9, user_id=621780ee9f5e45b3a1694b261cc36ebb, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.033311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75aaf-ec57-4900-abc2-2bb020acc39e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.039343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388295d3-3e03-4826-bb01-4ff655945431 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.049388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.050101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.050321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.050562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] PATH_INFO: `/v3/projects/0530a7155d5145d58aae01998f339394` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.052131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0530a7155d5145d58aae01998f339394)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.054347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.059922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 998/1990] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:26 2022] PUT /identity/v3/projects/e4904ee81cf34cf780bc90c7bdbb44d9/users/621780ee9f5e45b3a1694b261cc36ebb/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:27.071546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.071828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.072095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.102596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] MFA Rules not processed for user `621780ee9f5e45b3a1694b261cc36ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:27.104018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.115341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0530a7155d5145d58aae01998f339394', 'request_id': 'req-06a224a3-2950-4f4b-bb99-768053a9506b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.126063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0530a7155d5145d58aae01998f339394', 'request_id': 'req-06a224a3-2950-4f4b-bb99-768053a9506b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.133217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0530a7155d5145d58aae01998f339394', 'request_id': 'req-06a224a3-2950-4f4b-bb99-768053a9506b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.149799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] The token cache is being invalidate because project 0530a7155d5145d58aae01998f339394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:27.150588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.157490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.159329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 993/1991] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:27 2022] DELETE /identity/v3/projects/0530a7155d5145d58aae01998f339394 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:27.163279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.164708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.180404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 999/1992] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:27.184728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.186105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.236664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a224a3-2950-4f4b-bb99-768053a9506b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.240832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:27.241668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.242316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.242645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.243000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] PATH_INFO: `/v3/users/5bd580b7ac934a27a5cfa10036da4180` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.244576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd580b7ac934a27a5cfa10036da4180)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.246853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.262702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b7125-5b95-43fb-be03-ba441939d63f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.268581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.269261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.269542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.269813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.270469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.272435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.302862 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1000/1993] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:27.306950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.307277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd580b7ac934a27a5cfa10036da4180'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.308004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd580b7ac934a27a5cfa10036da4180'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.308750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd580b7ac934a27a5cfa10036da4180'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.321147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd580b7ac934a27a5cfa10036da4180'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.330933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd580b7ac934a27a5cfa10036da4180'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.335827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:27.348392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 994/1994] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:27 2022] DELETE /identity/v3/users/5bd580b7ac934a27a5cfa10036da4180 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:27.372244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292478-2310-47ff-a0ea-af3747b0324c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.432322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.433035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.433320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.433598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.434250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.436250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.466192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.466965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1001/1995] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:27.467713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.481876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021f1b1-9d13-4a51-a439-8b9575dcce5a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.487592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.488176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.488548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.488815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.489506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.491403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.519771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.530875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 995/1996] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:27.535515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc368-4006-4135-a8de-7fbe996c4359 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.541979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.542671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.542990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.543215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] PATH_INFO: `/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b/users/288f347bf9d3478fb4de2107d600f4e1/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.562138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed536bee78ea4bd9b8b9a535cd2e437b, user_id=288f347bf9d3478fb4de2107d600f4e1, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.565097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.585415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1002/1997] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:27 2022] PUT /identity/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b/users/288f347bf9d3478fb4de2107d600f4e1/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:27.590201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.608682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95c448-d6fe-42e4-be2a-123919bdfd03 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.651376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.653338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.709322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.710057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:27.710301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.710803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.711458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.712116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.713896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.727080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 996/1998] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:27.731353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.738293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7523aa-edc6-4c66-b7c2-6a72d2ea1a0f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.742669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d9bfc-1107-4279-b5b8-bc32b011796b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:27.743556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.744223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.744453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.744849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] PATH_INFO: `/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.746010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c02e1786ff4cc38fc9f8126df365e0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.747809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:27.747934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.751645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.751946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.752231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] PATH_INFO: `/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b/users/288f347bf9d3478fb4de2107d600f4e1/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.754268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed536bee78ea4bd9b8b9a535cd2e437b, user_id=288f347bf9d3478fb4de2107d600f4e1, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:27.757051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3c59-8a2c-4367-8ed1-681287fa8132 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:27.779926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 997/1999] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:27 2022] PUT /identity/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b/users/288f347bf9d3478fb4de2107d600f4e1/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:27.790771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.791082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.791541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.821816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] MFA Rules not processed for user `288f347bf9d3478fb4de2107d600f4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:27.823040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.824135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c02e1786ff4cc38fc9f8126df365e0', 'request_id': 'req-8eaadfb6-a014-471a-8562-40c1dbf072cb'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.840829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c02e1786ff4cc38fc9f8126df365e0', 'request_id': 'req-8eaadfb6-a014-471a-8562-40c1dbf072cb'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.850328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c02e1786ff4cc38fc9f8126df365e0', 'request_id': 'req-8eaadfb6-a014-471a-8562-40c1dbf072cb'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.862216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] The token cache is being invalidate because project d5c02e1786ff4cc38fc9f8126df365e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:27.862510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.863265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8eaadfb6-a014-471a-8562-40c1dbf072cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:27.864971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1003/2000] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:27 2022] DELETE /identity/v3/projects/d5c02e1786ff4cc38fc9f8126df365e0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:27.871846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee9c1-177a-4f7a-9389-93e5d8101d95 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.872280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee9c1-177a-4f7a-9389-93e5d8101d95 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.872499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ee9c1-177a-4f7a-9389-93e5d8101d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.894691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fb1ee9c1-177a-4f7a-9389-93e5d8101d95 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:27.895919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fb1ee9c1-177a-4f7a-9389-93e5d8101d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.929021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 998/2001] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:27.942246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:27.944296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:27.967033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1004/2002] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:27.976089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:27.976394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:27.976776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:27.996752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:27.997991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.005046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13242e75-3a4d-4a6f-9129-5ae1e89a30cd None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.006214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1005/2003] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:28.009237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.009875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.010155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.010430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.010613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.017289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:28.020263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b80ac-3baa-45cc-87cf-8409fd35ce39 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.022480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.024154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.025128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.025937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.026213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.026602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.027229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:28.027535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.029291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.037547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 999/2004] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:27 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:28.043001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1006/2005] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:28.047716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.060843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccdf5a-0103-405c-9f27-7d27037340d0 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.066407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.067140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.067443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.067717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.068363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.071335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.108079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1000/2006] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:28.111475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.121896 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fafc2-e5e6-4079-8c94-1f42589ed849 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.174128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:28.194311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.196365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.197762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.198786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.199265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.199747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.200542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.202871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.209889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acdda4-90fe-477f-996b-ef4de632d5a1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.220732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.223920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.223920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.223920 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] PATH_INFO: `/v3/users/621780ee9f5e45b3a1694b261cc36ebb` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.224745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621780ee9f5e45b3a1694b261cc36ebb)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.226865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.239323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1007/2007] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:28.243336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.255373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b0b5-f80a-4b1a-bb21-71354e547c3c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.262755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.263452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.263812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.264030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.264809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.266872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.282219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1008/2008] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:28.285679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.285889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621780ee9f5e45b3a1694b261cc36ebb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:28.286651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621780ee9f5e45b3a1694b261cc36ebb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:28.287325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621780ee9f5e45b3a1694b261cc36ebb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:28.295209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d0a90-1ef3-4072-aa71-79da45f95ef5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.300170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.300379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621780ee9f5e45b3a1694b261cc36ebb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:28.300846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.301167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.301441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.302095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.303708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.308806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-82693ff8-3dba-4d0e-9f71-d9c2ad9ae719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621780ee9f5e45b3a1694b261cc36ebb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:28.314163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1009/2009] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:28.318351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.320021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.321906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1001/2010] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:28 2022] DELETE /identity/v3/users/621780ee9f5e45b3a1694b261cc36ebb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:28.326225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.326509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.326784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.335179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c20e7-5cae-4dae-9fc7-543cee95500c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.347116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:28.348393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.397151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.397733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.398016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.398401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] PATH_INFO: `/v3/projects/a24d3e9ebc98489ea6f0900107c6cb24/users/f5a4d1b0e4df445eaa7a6bafccbdc649/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.413784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24d3e9ebc98489ea6f0900107c6cb24, user_id=f5a4d1b0e4df445eaa7a6bafccbdc649, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.415618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1002/2011] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:28.416456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fa7b9-c41f-4034-a2e4-09fe8401dd30 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.425873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.427321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.431792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1010/2012] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:28 2022] PUT /identity/v3/projects/a24d3e9ebc98489ea6f0900107c6cb24/users/f5a4d1b0e4df445eaa7a6bafccbdc649/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:28.443314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.443599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.443874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.476529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] MFA Rules not processed for user `f5a4d1b0e4df445eaa7a6bafccbdc649`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:28.477814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:28.481583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:28.494976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c757-8a70-4c2c-95ff-4f8fc7701c36 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.547605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1011/2013] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:28.547983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.548548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.548548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.548755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.552113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.586519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:28.613227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.614727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.620126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6702f94-b12d-459d-bdb0-c98302086be7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.624509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1003/2014] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:28.625066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.625695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.625973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.626244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.626880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.628806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.665660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1012/2015] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:28.667078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.687378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a98a3-e183-40bf-abda-ce6658040cfb service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.765760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.766712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.766712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.767043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.768130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.770160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.797777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1004/2016] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:28 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:28.802514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.815558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b40e64-ece9-4be6-b53b-0d4bc28bf6f8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.822124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.822968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.823215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.823494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.824800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.826087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.839861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1013/2017] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:28.841090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.851671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45833-c8b0-44ea-823f-89bf39d4f07f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.856331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:28.857037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:28.857386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:28.857625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] PATH_INFO: `/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015/users/4e414adea5e141c6b385ce6ca86df9bc/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:28.893977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3f7747a3494153a9e5dfb3b0de9015, user_id=4e414adea5e141c6b385ce6ca86df9bc, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:28.896800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:28.912632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1005/2018] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:28 2022] PUT /identity/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015/users/4e414adea5e141c6b385ce6ca86df9bc/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:28.917573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.928245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc609b6f-ed73-4422-ace2-7d02c0026308 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:28.977750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:28.980264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.008265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:29.017094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.017722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.017998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.018271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.018926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.020572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:29.037307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1014/2019] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:29.038538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:29.049599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6fe8-952c-45d8-a3ce-135a61c02215 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:29.055282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.055973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.056256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.056536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] PATH_INFO: `/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015/users/4e414adea5e141c6b385ce6ca86df9bc/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.058809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3f7747a3494153a9e5dfb3b0de9015, user_id=4e414adea5e141c6b385ce6ca86df9bc, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.062708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495731-ba6e-4b3b-806c-51b24663ea28 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:29.075994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e47d8e-2db4-4fe3-b6fb-bda673b71235 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:29.076539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1015/2020] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:29 2022] PUT /identity/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015/users/4e414adea5e141c6b385ce6ca86df9bc/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:29.089228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac688-710e-4895-afdd-38dc826a658d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.090082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac688-710e-4895-afdd-38dc826a658d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.090975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ac688-710e-4895-afdd-38dc826a658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.130689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-425ac688-710e-4895-afdd-38dc826a658d None None] MFA Rules not processed for user `4e414adea5e141c6b385ce6ca86df9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:29.132146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-425ac688-710e-4895-afdd-38dc826a658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.146750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.147402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.147684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.147950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] PATH_INFO: `/v3/projects/e4904ee81cf34cf780bc90c7bdbb44d9` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.149161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4904ee81cf34cf780bc90c7bdbb44d9)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.151415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:29.295290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4904ee81cf34cf780bc90c7bdbb44d9', 'request_id': 'req-548d3dd8-8385-4eb9-8576-0ca3047c27ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.302015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1016/2021] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:29.306079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4904ee81cf34cf780bc90c7bdbb44d9', 'request_id': 'req-548d3dd8-8385-4eb9-8576-0ca3047c27ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.314136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4904ee81cf34cf780bc90c7bdbb44d9', 'request_id': 'req-548d3dd8-8385-4eb9-8576-0ca3047c27ea'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.331395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac688-710e-4895-afdd-38dc826a658d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:29.333927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-425ac688-710e-4895-afdd-38dc826a658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.338656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] The token cache is being invalidate because project e4904ee81cf34cf780bc90c7bdbb44d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:29.338999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.351700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.351700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1006/2022] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:28 2022] DELETE /identity/v3/projects/e4904ee81cf34cf780bc90c7bdbb44d9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:29.351700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:29.356988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.362185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:29.422723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:29.427398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ac688-710e-4895-afdd-38dc826a658d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:29.439122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d3dd8-8385-4eb9-8576-0ca3047c27ea admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:29.447737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.448510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.448830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.449121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] PATH_INFO: `/v3/users/288f347bf9d3478fb4de2107d600f4e1` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.450917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288f347bf9d3478fb4de2107d600f4e1)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.453529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:29.494627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.495308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.495583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.495852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.497666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.514597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288f347bf9d3478fb4de2107d600f4e1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.515782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288f347bf9d3478fb4de2107d600f4e1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.516541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288f347bf9d3478fb4de2107d600f4e1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.530628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288f347bf9d3478fb4de2107d600f4e1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.541645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288f347bf9d3478fb4de2107d600f4e1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:29.561174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1007/2023] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:29 2022] DELETE /identity/v3/users/288f347bf9d3478fb4de2107d600f4e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:29.577881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.579366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:29.593918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1017/2024] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:29.863201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:29.864506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:29.960344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3c149-bb0d-4558-be77-d0c290514aa0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:29.965698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:29.966346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:29.966618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:29.967028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] PATH_INFO: `/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:29.968419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed536bee78ea4bd9b8b9a535cd2e437b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:29.973168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.039717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed536bee78ea4bd9b8b9a535cd2e437b', 'request_id': 'req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.050039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed536bee78ea4bd9b8b9a535cd2e437b', 'request_id': 'req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.059459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.060996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.064084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed536bee78ea4bd9b8b9a535cd2e437b', 'request_id': 'req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.075596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade9880-a5b2-41b8-b1f7-891abfc0c750 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.076692 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] The token cache is being invalidate because project ed536bee78ea4bd9b8b9a535cd2e437b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:30.077046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.077842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1bc3c9e6-2c8d-4f83-9d60-b1b52a1a5297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.079418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1008/2025] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:29 2022] DELETE /identity/v3/projects/ed536bee78ea4bd9b8b9a535cd2e437b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:30.084464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d11af4-ecc6-4231-a5ad-45a9f355a828 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.084815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d11af4-ecc6-4231-a5ad-45a9f355a828 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.085189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d11af4-ecc6-4231-a5ad-45a9f355a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.093791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:30.107514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-99d11af4-ecc6-4231-a5ad-45a9f355a828 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:30.108921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-99d11af4-ecc6-4231-a5ad-45a9f355a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.155945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.156589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.156865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.157177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] PATH_INFO: `/v3/users/f5a4d1b0e4df445eaa7a6bafccbdc649` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.158298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a4d1b0e4df445eaa7a6bafccbdc649)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.160452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.178279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1009/2026] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:30.186089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.186583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.186724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.195492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:30.219159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:30.220378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.222311 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a4d1b0e4df445eaa7a6bafccbdc649'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.222988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a4d1b0e4df445eaa7a6bafccbdc649'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.223578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a4d1b0e4df445eaa7a6bafccbdc649'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.229872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1010/2027] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:30.234271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.236005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a4d1b0e4df445eaa7a6bafccbdc649'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.242848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-34f1ad2c-72ef-43cb-b013-a6020b9c42f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a4d1b0e4df445eaa7a6bafccbdc649'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.243565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069e0d-31b5-4b9e-8e0a-ffb0d4873359 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.248959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.249784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.250078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.250491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.251102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:30.251459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.253553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.257910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1018/2028] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:30 2022] DELETE /identity/v3/users/f5a4d1b0e4df445eaa7a6bafccbdc649 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:30.262303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.262583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.262876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.269718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1011/2029] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:30.274314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.283998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:30.284304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53cede-bc5a-4917-befc-49f2a3cfba92 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.285406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.346446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.347068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.347342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.347660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.348297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.350705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.372733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1019/2030] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:30.389529 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1012/2031] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:30.396742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.398420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.398549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.465844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0f29a-cd30-4af8-b08c-14a027ec869b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.478153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db586577-7382-4b3b-a53a-de025d1660cc admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.483681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.484828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.485095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.485373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.486401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.488682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.511608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:30.527956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1013/2032] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:30.528164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.528318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.528523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.528804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.529427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.540461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.541533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c4751-fdde-4bb8-8555-5f6f048ecc06 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.541978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.546358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:30.547158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.547786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.548064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.548466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.549201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.550774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.555264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1020/2033] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:30.565996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1014/2034] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:30.569935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.581412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bd57-3c26-48a2-ac1f-3dd7234f94c6 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.586686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.587600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.587819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.588032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.588672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.590630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2530-4786-46b4-99ed-70f9a962265e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.609042 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1021/2035] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:30.613340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.628401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e71e8-27cf-4c90-a784-7580fe669835 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.642526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.643735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.643735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.643735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] PATH_INFO: `/v3/projects/161506467b474052ab6b391fde3f7890/users/80daf8ead209401989cedf5f21901de8/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.665273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161506467b474052ab6b391fde3f7890, user_id=80daf8ead209401989cedf5f21901de8, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.668509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.697412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1015/2036] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:30 2022] PUT /identity/v3/projects/161506467b474052ab6b391fde3f7890/users/80daf8ead209401989cedf5f21901de8/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:30.703542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.703833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.704149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.733790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:30.735041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.803851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1022/2037] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:30.813811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.860267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:30.861752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:30.874681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64165a6-aed8-4a31-b4fc-e8c5f6133e59 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.883510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcb812-17c3-4682-ada9-09facb74a350 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:30.887678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.888305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:30.888426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.888657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.888999 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] PATH_INFO: `/v3/projects/a24d3e9ebc98489ea6f0900107c6cb24` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.889139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:30.889227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:30.889545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:30.890931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24d3e9ebc98489ea6f0900107c6cb24)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.895998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.904731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:30.906809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:30.917272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1016/2038] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:30.958163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24d3e9ebc98489ea6f0900107c6cb24', 'request_id': 'req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.967577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24d3e9ebc98489ea6f0900107c6cb24', 'request_id': 'req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.975294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24d3e9ebc98489ea6f0900107c6cb24', 'request_id': 'req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.990743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] The token cache is being invalidate because project a24d3e9ebc98489ea6f0900107c6cb24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:30.991150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.991878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:30.993494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1023/2039] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:30 2022] DELETE /identity/v3/projects/a24d3e9ebc98489ea6f0900107c6cb24 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:30.997700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:31.009212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36b3f8-9036-419f-bbfd-ff04ef12bc85 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:31.091355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:31.091987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:31.092257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:31.092523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] PATH_INFO: `/v3/users/4e414adea5e141c6b385ce6ca86df9bc` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:31.093781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e414adea5e141c6b385ce6ca86df9bc)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:31.095724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:31.155517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e414adea5e141c6b385ce6ca86df9bc'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.156374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e414adea5e141c6b385ce6ca86df9bc'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.157095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e414adea5e141c6b385ce6ca86df9bc'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.183283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e414adea5e141c6b385ce6ca86df9bc'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.187355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:31.194689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3b230c1a-09f4-45e4-ae4e-7a2b7df6b869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e414adea5e141c6b385ce6ca86df9bc'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.212054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1017/2040] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:30 2022] DELETE /identity/v3/users/4e414adea5e141c6b385ce6ca86df9bc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:31.624071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:31.626335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:31.643099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f200d0-b7ba-4eb6-b7d8-c952a9cd933d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:31.729372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:31.730541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:31.731333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:31.731814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] PATH_INFO: `/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:31.734051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3f7747a3494153a9e5dfb3b0de9015)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:31.738041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:31.754073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:31.756414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:31.756910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:31.757027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:31.799327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] MFA Rules not processed for user `80daf8ead209401989cedf5f21901de8`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:31.800664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:31.816555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3f7747a3494153a9e5dfb3b0de9015', 'request_id': 'req-3d72629a-23e7-49c7-b502-32a8e0cd360e'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.826645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3f7747a3494153a9e5dfb3b0de9015', 'request_id': 'req-3d72629a-23e7-49c7-b502-32a8e0cd360e'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.834375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3f7747a3494153a9e5dfb3b0de9015', 'request_id': 'req-3d72629a-23e7-49c7-b502-32a8e0cd360e'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.850824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] The token cache is being invalidate because project 7f3f7747a3494153a9e5dfb3b0de9015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:31.853038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.854641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3d72629a-23e7-49c7-b502-32a8e0cd360e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:31.860184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1024/2041] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:31 2022] DELETE /identity/v3/projects/7f3f7747a3494153a9e5dfb3b0de9015 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:31.861840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1082d6-c408-4994-80b6-9c6331df4b5f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:31.862135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1082d6-c408-4994-80b6-9c6331df4b5f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:31.862399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1082d6-c408-4994-80b6-9c6331df4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:31.886942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9d1082d6-c408-4994-80b6-9c6331df4b5f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:31.888159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9d1082d6-c408-4994-80b6-9c6331df4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:31.918948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1018/2042] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:31.923772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:31.925204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:31.992527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1025/2043] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:32.000532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.000821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.001176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.022459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:32.023742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:32.025847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162677-3027-4e04-a20a-148cc0e88128 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.030975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.031604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.032014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.032324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.033043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1026/2044] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:32.033144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.035280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.046149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.073881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1019/2045] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:31 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:32.074715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7456-ce3b-4f72-b048-6e2d001b31d6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.089615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.141032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.141689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.142002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.142271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.142998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:32.143329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.145028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.160948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1027/2046] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:32.162515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.169668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777225a3-7810-4215-86e7-b29442fd3e02 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.173081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9f488-fe69-46ab-9d71-4a3df8c3797a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.174844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.175526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.175811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.176013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.176647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.178646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.179016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.179655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.179930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.180204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.180817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.182750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.186778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:32.206219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1020/2047] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/users => generated 309 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:32.210266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.221511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1028/2048] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:32.224503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28827f3-476c-428c-ac8f-e99f39499c00 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.225645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.234410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:32.286579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.287234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.287511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.287782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.288430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.290081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.291961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6878ace-61bd-4c2a-9398-7d95730af0ea admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.301664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.302296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.302398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1021/2049] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:32.302569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.302834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.303543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.305853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.306497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.316631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b083-106f-4022-b22b-7ed23e0ba0d3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.321483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.322308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.322583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.322855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] PATH_INFO: `/v3/projects/544b4d73fda54457a9a7da42a2d261c0/users/53b5c70b5d9d4a76a0a20efd9f5ebe94/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.332721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1029/2050] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:32.333937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.341120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544b4d73fda54457a9a7da42a2d261c0, user_id=53b5c70b5d9d4a76a0a20efd9f5ebe94, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.344168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.345564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18571fc5-ac73-4175-99af-f8177b7c48e8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.350576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.351234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.351513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.351803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.352673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.354414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.358484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1022/2051] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:32 2022] PUT /identity/v3/projects/544b4d73fda54457a9a7da42a2d261c0/users/53b5c70b5d9d4a76a0a20efd9f5ebe94/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:32.362440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.365059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1030/2052] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:32.369124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.379527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926845d-ffae-43fc-b061-c00716c42f33 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.451400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.452178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.452375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3f74-b55e-4bce-9c4f-90ef18c4c572 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.452499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.452726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.453406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.455099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.461365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.462111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.462518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.462853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.463567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.465342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.469121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1031/2053] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:32.474143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.490752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1023/2054] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:32.491289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365245d-4b64-4587-ae4e-3834fb4bbeb8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.492971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.496136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.497050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.497398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.497742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] PATH_INFO: `/v3/projects/a4702835adcd458db69e30ef89263796/users/bcf7a2f5de224a19988f140924f200ea/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.507307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5ef0-2888-4a97-be0b-08e2c66dc692 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.512833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.513559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.513838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.514117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] PATH_INFO: `/v3/projects/544b4d73fda54457a9a7da42a2d261c0/users/53b5c70b5d9d4a76a0a20efd9f5ebe94/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.516464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544b4d73fda54457a9a7da42a2d261c0, user_id=53b5c70b5d9d4a76a0a20efd9f5ebe94, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.518675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4702835adcd458db69e30ef89263796, user_id=bcf7a2f5de224a19988f140924f200ea, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.519268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4476-c8ac-4ee2-85a6-24ab6374f336 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.521497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.536994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1024/2055] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:32 2022] PUT /identity/v3/projects/544b4d73fda54457a9a7da42a2d261c0/users/53b5c70b5d9d4a76a0a20efd9f5ebe94/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:32.545633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1032/2056] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:32 2022] PUT /identity/v3/projects/a4702835adcd458db69e30ef89263796/users/bcf7a2f5de224a19988f140924f200ea/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:32.557712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.557998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.558318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.593830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] MFA Rules not processed for user `bcf7a2f5de224a19988f140924f200ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:32.595232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:32.640997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:32.678332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1025/2057] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:32.682313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.754867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:32.759780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8bda-d269-4ed2-84ab-45e5a66aa0ab admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.766339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.766993 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.767545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.768136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.769166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.771248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.803361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1033/2058] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:32.808586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.820870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958fc5c-5907-4d30-87a4-6f86af3be925 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.887319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.887922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.888193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.888457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.889120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.891623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.916658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1026/2059] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:32 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:32.920669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.935808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110895-c27d-487b-a878-815fdca4161d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.941582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.942431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.942777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.943587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.943871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:32.945705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:32.962986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1034/2060] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:32.964166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:32.974535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564205be-3a73-4886-a627-abdc2166e648 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:32.979397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:32.980102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:32.980510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:32.980793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] PATH_INFO: `/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8/users/0cdc6a27fbfa4aab8f2eebe955cb9b02/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:32.997561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa7f81b5c554e48baa2522a3cb074f8, user_id=0cdc6a27fbfa4aab8f2eebe955cb9b02, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:33.000185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:33.017287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1027/2061] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:32 2022] PUT /identity/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8/users/0cdc6a27fbfa4aab8f2eebe955cb9b02/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:33.021693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:33.032641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7cf8-de5d-4302-9581-b128ecf0df0c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:33.098265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:33.099296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:33.099724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:33.099983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:33.100638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:33.102831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95379151-f37c-4af0-9615-da5202a6fde1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:33.114071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1035/2062] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:33.118067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:33.130252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254f0b-1ec8-4104-bf58-84f7e8959f93 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:33.135748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:33.136434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:33.136707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:33.137196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] PATH_INFO: `/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8/users/0cdc6a27fbfa4aab8f2eebe955cb9b02/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:33.139639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa7f81b5c554e48baa2522a3cb074f8, user_id=0cdc6a27fbfa4aab8f2eebe955cb9b02, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:33.143699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:33.156377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1028/2063] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:33 2022] PUT /identity/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8/users/0cdc6a27fbfa4aab8f2eebe955cb9b02/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:33.167861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c254-3e47-4241-8915-3f5a47e59561 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:33.168209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c254-3e47-4241-8915-3f5a47e59561 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:33.168418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c254-3e47-4241-8915-3f5a47e59561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:33.200004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8772c254-3e47-4241-8915-3f5a47e59561 None None] MFA Rules not processed for user `0cdc6a27fbfa4aab8f2eebe955cb9b02`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:33.201411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8772c254-3e47-4241-8915-3f5a47e59561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:33.318081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1036/2064] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:33.329743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:33.332010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:33.393491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc918b-58be-4721-aa90-991f7e4ddf62 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:33.393812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc918b-58be-4721-aa90-991f7e4ddf62 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:33.394080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc918b-58be-4721-aa90-991f7e4ddf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:33.417202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1ce8-6bec-472a-a242-2fe80a6737a7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:33.421156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:33.421774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:33.422119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:33.422313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:33.444344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cdfc918b-58be-4721-aa90-991f7e4ddf62 None None] MFA Rules not processed for user `53b5c70b5d9d4a76a0a20efd9f5ebe94`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:33.445117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cdfc918b-58be-4721-aa90-991f7e4ddf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:33.480033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:33.503142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:33.505306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0a10-902a-4a3a-9be5-99b0e6b03bbd service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:33.512347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:33.519031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1029/2065] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:33.566702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1037/2066] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:34.265609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:34.266129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:34.266246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:34.268116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1030/2067] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:46:34.279411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:34.280024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:34.280125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:34.301542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] MFA Rules not processed for user `176b283110c240159bbc525fd6745f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:34.303174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:34.378178 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1038/2068] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:34.392519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:34.394824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:34.416861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047f1c-0763-475f-b9c9-2e20896a0ae9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:34.421886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:34.422532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:34.422790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:34.423057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:34.431846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:34.433488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:34.444091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1031/2069] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:34.861517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:34.929671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712b618-5c87-4f19-9101-a75e88581f28 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:34.935131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:34.936115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:34.936555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:34.936984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] PATH_INFO: `/v3/users/80daf8ead209401989cedf5f21901de8` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:34.938367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80daf8ead209401989cedf5f21901de8)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:34.940448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:35.012160 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80daf8ead209401989cedf5f21901de8'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.012831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80daf8ead209401989cedf5f21901de8'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.013736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80daf8ead209401989cedf5f21901de8'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.044264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80daf8ead209401989cedf5f21901de8'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.062888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80daf8ead209401989cedf5f21901de8'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.066379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:35.082989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1039/2070] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:34 2022] DELETE /identity/v3/users/80daf8ead209401989cedf5f21901de8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:35.291237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:35.308824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4334971-4d75-4d1a-af16-92b05a5c12b3 service placement] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:35.377569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:35.378198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:35.378528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:35.378738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] PATH_INFO: `/v3/projects/161506467b474052ab6b391fde3f7890` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:35.379899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=161506467b474052ab6b391fde3f7890)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:35.381926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:35.438171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161506467b474052ab6b391fde3f7890', 'request_id': 'req-0a55f924-8443-4e2f-a621-f6e62735a5bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.447253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161506467b474052ab6b391fde3f7890', 'request_id': 'req-0a55f924-8443-4e2f-a621-f6e62735a5bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.454910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161506467b474052ab6b391fde3f7890', 'request_id': 'req-0a55f924-8443-4e2f-a621-f6e62735a5bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.467675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] The token cache is being invalidate because project 161506467b474052ab6b391fde3f7890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:35.467964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.468637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.470440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1032/2071] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:35 2022] DELETE /identity/v3/projects/161506467b474052ab6b391fde3f7890 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:35.474370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:35.475892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:35.490005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3aa5a-6286-40ad-aa84-ab0ec7bbb061 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:35.552109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:35.552893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:35.553196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:35.553471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] PATH_INFO: `/v3/users/53b5c70b5d9d4a76a0a20efd9f5ebe94` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:35.554708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b5c70b5d9d4a76a0a20efd9f5ebe94)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:35.557534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:35.623484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b5c70b5d9d4a76a0a20efd9f5ebe94'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.624977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b5c70b5d9d4a76a0a20efd9f5ebe94'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.625652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b5c70b5d9d4a76a0a20efd9f5ebe94'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.641045 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b5c70b5d9d4a76a0a20efd9f5ebe94'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.649035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b7fbcb19-42fd-4c02-a1ce-ce88ed1c1868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b5c70b5d9d4a76a0a20efd9f5ebe94'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.665511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1040/2072] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:35 2022] DELETE /identity/v3/users/53b5c70b5d9d4a76a0a20efd9f5ebe94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:35.845101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:35.846710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:35.859921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f924-8443-4e2f-a621-f6e62735a5bb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:35.913675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:35.921034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:35.921701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:35.921983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:35.922313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] PATH_INFO: `/v3/projects/544b4d73fda54457a9a7da42a2d261c0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:35.923616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=544b4d73fda54457a9a7da42a2d261c0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:35.925929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:35.976308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544b4d73fda54457a9a7da42a2d261c0', 'request_id': 'req-25becf22-ae23-46c7-a8c0-f3695341f458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.985310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544b4d73fda54457a9a7da42a2d261c0', 'request_id': 'req-25becf22-ae23-46c7-a8c0-f3695341f458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:35.995347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544b4d73fda54457a9a7da42a2d261c0', 'request_id': 'req-25becf22-ae23-46c7-a8c0-f3695341f458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:36.008156 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] The token cache is being invalidate because project 544b4d73fda54457a9a7da42a2d261c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:36.008443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:36.009206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-25becf22-ae23-46c7-a8c0-f3695341f458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:36.010849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1033/2073] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:35 2022] DELETE /identity/v3/projects/544b4d73fda54457a9a7da42a2d261c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:36.016337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.016619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.016874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.037630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:36.038845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:36.103395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1041/2074] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:36.112503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.112783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.113065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.132925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:36.134208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:36.147466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1034/2075] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:36.153835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.164427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f75eec-de8d-402c-a0c4-2314deb43b5e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.169861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.170512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.170961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.171249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.171953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:36.172469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.174479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.185105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:36.191452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1042/2076] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:36.194389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.204132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415559-465d-4aeb-877d-1acc35e424d8 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.209141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.211383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.211669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.211948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.212609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.214573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.249562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1035/2077] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:36.253995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.266961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52642746-b7f2-420b-aa1b-3dd4791e590b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.330273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.330882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.331155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.331426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.332058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.334105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.357356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1043/2078] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:36.361813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.372440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080e75-fcf9-4fb0-9679-3e5506cd46a6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.378683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.379447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.379690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.379974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.380744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.382472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.394454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1036/2079] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:36.398756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.409098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e21ac-bc36-4669-a4da-3be53fcf2de9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.414075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.414692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.414970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.415242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.416002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.417741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d269-c5a8-416c-a028-0c733b51c99e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.429529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1044/2080] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:36.435329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.448005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b7fc-1078-4c62-b3d7-6bda1e1e35b0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.453043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.453672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.453943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.454213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] PATH_INFO: `/v3/projects/2435f8e526cb4e15b63919090f7a07c3/users/4c08afe86633459eb664a86b7db349b2/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.470203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2435f8e526cb4e15b63919090f7a07c3, user_id=4c08afe86633459eb664a86b7db349b2, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.473738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.500952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1037/2081] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:36 2022] PUT /identity/v3/projects/2435f8e526cb4e15b63919090f7a07c3/users/4c08afe86633459eb664a86b7db349b2/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:36.511364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.511849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.511928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.553705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] MFA Rules not processed for user `4c08afe86633459eb664a86b7db349b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:36.554918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:36.630641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1045/2082] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:36.635619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.720122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4909b07-9087-4bd8-9281-b1b97ae42774 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.725470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.726098 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.726477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.726651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.727373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.729464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.766412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1038/2083] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:36.767594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.779248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b08e-e944-4e4f-89b2-ab2cdcc3e4f1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.895315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.896516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.896889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.897251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.897964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.900418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.930256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:36.937998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1046/2084] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:36 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:36.943060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:36.954261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b458b0-0a96-4e32-9dbb-a490e44f2835 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:36.960426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:36.961641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:36.961917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:36.962287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:36.963495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:36.965216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:36.968271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:36.979410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1039/2085] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:36.984126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.013106 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7770ce-42a9-4e06-95fb-9a2655b91299 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.018526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.019783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.019783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.020135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] PATH_INFO: `/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd/users/4a0c8c98e5054aa8a23c0f3067319d39/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.042373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a0124d1aa84294aa6a4ad3b6d205fd, user_id=4a0c8c98e5054aa8a23c0f3067319d39, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.045424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.062345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1047/2086] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:36 2022] PUT /identity/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd/users/4a0c8c98e5054aa8a23c0f3067319d39/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:37.066187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.077975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d3508-dd48-495d-b80c-9b01c1321bc8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.168513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.169267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.169606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.169946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.170733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.172432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d237d-907f-492a-8a7e-5c563b180ed6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.183642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1040/2087] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:37.188189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.200869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f6507-f288-411a-bf7f-67a5b2073ece admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.213419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.214118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.214389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.220510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] PATH_INFO: `/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd/users/4a0c8c98e5054aa8a23c0f3067319d39/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.220510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a0124d1aa84294aa6a4ad3b6d205fd, user_id=4a0c8c98e5054aa8a23c0f3067319d39, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.221388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.236873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1048/2088] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:37 2022] PUT /identity/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd/users/4a0c8c98e5054aa8a23c0f3067319d39/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:37.248530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.249430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.249430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.298740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] MFA Rules not processed for user `4a0c8c98e5054aa8a23c0f3067319d39`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:37.300107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:37.386368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1041/2089] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:37.398449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.400949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:37.474783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00568f8-5ccb-47cf-9c10-ed7c5bd293d2 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.478624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.479576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.479942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.480284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.492848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.494574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.506653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1049/2090] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:37.573117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.574732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:37.595910 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:37.608835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eb92f-39be-49d8-9c0b-aef44a85f940 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.616886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.617554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.617936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.618209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.655454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8739c-9709-45c6-95c1-6912717b577b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:37.661081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:37.661738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:37.662016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:37.662288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] PATH_INFO: `/v3/users/88dc5fe8febc4f0c883f40477e3f4919` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:37.664044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=88dc5fe8febc4f0c883f40477e3f4919)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.666415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.684608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:37.686312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:37.689898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:37.699157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1050/2091] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:37.722656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88dc5fe8febc4f0c883f40477e3f4919'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:37.723295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88dc5fe8febc4f0c883f40477e3f4919'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:37.723886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88dc5fe8febc4f0c883f40477e3f4919'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:37.739844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88dc5fe8febc4f0c883f40477e3f4919'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:37.750122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88dc5fe8febc4f0c883f40477e3f4919'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:37.769562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1042/2092] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:37 2022] DELETE /identity/v3/users/88dc5fe8febc4f0c883f40477e3f4919 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:37.993778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.006754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c679-780f-4b52-91d5-088ecd0293e8 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.040426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.041918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.098411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.099056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.099331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.099613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] PATH_INFO: `/v3/projects/6155a8cf404647e798bd9943d7883034` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.101500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6155a8cf404647e798bd9943d7883034)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.103782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.106302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:38.116953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d396-dda3-4d4b-b58b-b0ba4a082aba admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.120650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.121378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.121726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.122001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.123890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.155280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6155a8cf404647e798bd9943d7883034', 'request_id': 'req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.164249 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6155a8cf404647e798bd9943d7883034', 'request_id': 'req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.171642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6155a8cf404647e798bd9943d7883034', 'request_id': 'req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.182991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] The token cache is being invalidate because project 6155a8cf404647e798bd9943d7883034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:38.183265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.183917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.185779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1051/2093] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:37 2022] DELETE /identity/v3/projects/6155a8cf404647e798bd9943d7883034 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:38.190239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.190481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.191935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.192051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.201629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1043/2094] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:38.262213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaa56a-954b-4933-a18f-dfb3fbf37d9b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.267483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.268128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.268397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.268663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] PATH_INFO: `/v3/users/181921315e8f4426bcbeb10e7b8d8252` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.269947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181921315e8f4426bcbeb10e7b8d8252)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.271881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.328867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.333775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181921315e8f4426bcbeb10e7b8d8252'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.333775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181921315e8f4426bcbeb10e7b8d8252'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.333775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181921315e8f4426bcbeb10e7b8d8252'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.334605 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.350909 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181921315e8f4426bcbeb10e7b8d8252'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.355340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80686ee-f48f-40ab-a0af-7527428846f7 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.359366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9319b9e0-d364-4fd1-bcae-52f248cfe764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181921315e8f4426bcbeb10e7b8d8252'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.361535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.362458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.362837 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.363207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] PATH_INFO: `/v3/users/3fd3cb95ffd14d0b8d401fac6b6787fe` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.364832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3cb95ffd14d0b8d401fac6b6787fe)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.367253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.373948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1052/2095] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:38 2022] DELETE /identity/v3/users/181921315e8f4426bcbeb10e7b8d8252 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:38.422240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:38.427785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3cb95ffd14d0b8d401fac6b6787fe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.428804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3cb95ffd14d0b8d401fac6b6787fe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.429495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3cb95ffd14d0b8d401fac6b6787fe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.449496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3cb95ffd14d0b8d401fac6b6787fe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.466734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3cb95ffd14d0b8d401fac6b6787fe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.482033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1044/2096] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:38 2022] DELETE /identity/v3/users/3fd3cb95ffd14d0b8d401fac6b6787fe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:38.488135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.488135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.488135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.525099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:38.525099 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.530700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:38.608883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.610386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.619198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1053/2097] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:38.629382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.630842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.633312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c001b9d-38e2-4126-be6a-b7c3f9e9e37f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.638664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.639358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.639697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.639940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] PATH_INFO: `/v3/projects/737bfe43261a4a2898010e1db9d32024` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.641869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737bfe43261a4a2898010e1db9d32024)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.644331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.695650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858fcf-edb1-4f0a-a975-426a968e6936 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.697809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737bfe43261a4a2898010e1db9d32024', 'request_id': 'req-4584438f-9869-4afc-9cfb-68e3b52bde99'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.706590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737bfe43261a4a2898010e1db9d32024', 'request_id': 'req-4584438f-9869-4afc-9cfb-68e3b52bde99'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.713076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737bfe43261a4a2898010e1db9d32024', 'request_id': 'req-4584438f-9869-4afc-9cfb-68e3b52bde99'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.723432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] The token cache is being invalidate because project 737bfe43261a4a2898010e1db9d32024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:38.723746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.724381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4584438f-9869-4afc-9cfb-68e3b52bde99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:38.725959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1045/2098] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:38 2022] DELETE /identity/v3/projects/737bfe43261a4a2898010e1db9d32024 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:38.730668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530494-f8b8-46cf-8a0f-c9ce6d057ad8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.730938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530494-f8b8-46cf-8a0f-c9ce6d057ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.731200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6530494-f8b8-46cf-8a0f-c9ce6d057ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.747373 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.747988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.748266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.748573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.750406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c6530494-f8b8-46cf-8a0f-c9ce6d057ad8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:38.750538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.751587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c6530494-f8b8-46cf-8a0f-c9ce6d057ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.828064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1046/2099] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:38.828274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.828274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.830210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.830498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.830768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.834070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1054/2100] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:38.850828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:38.852190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:38.863964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1047/2101] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:38.865294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.875869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e248ed6-afb2-4fed-914c-6bcad6ae21e9 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.881201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.881831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.882109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.882376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.883033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:38.883473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.885456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.900140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1055/2102] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:38.905043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:38.916304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdcb5b2-6236-4225-939d-1c2edd2f5d08 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:38.928444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:38.929141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:38.929418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:38.929690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:38.930343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:38.932286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:38.989070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1048/2103] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:38 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:38.993468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.002483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:39.009974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a263690-49d1-489c-99c8-923dc08c48c9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.077044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.077667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.077939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.078200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.078826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.080802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.110512 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1056/2104] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:38 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:39.115547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.129894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a5ccf-3704-414e-b9ea-b59f2bb6a25c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.140554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.141473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.141935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.142188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.142934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.144754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.160370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1049/2105] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:39.162434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.166395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.170256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.179683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:39.183932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc658ddf-100f-491a-8e69-48a230539510 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.192595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.194107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.194447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.194720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.195220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86d0cb-b0d6-42dc-b267-af2188a4b46e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.195759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.197651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.207041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.207749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.208024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.208298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] PATH_INFO: `/v3/projects/0ebbe5b44ae2414cbf2ccf948e001551` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.211356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebbe5b44ae2414cbf2ccf948e001551)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.216105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.216764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1050/2106] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:39.218210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.234067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18002-1c5a-40b5-a19c-e948083a5a2a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.245851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.246552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.246812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.247094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] PATH_INFO: `/v3/projects/34a195fa1216482983d3b44bd5942ee1/users/6474d8fde0a648a58ae6bff95bf7edb7/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.271065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a195fa1216482983d3b44bd5942ee1, user_id=6474d8fde0a648a58ae6bff95bf7edb7, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.274364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e663-e6dc-4659-88ce-69db1c94be88 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.290163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1051/2107] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:39 2022] PUT /identity/v3/projects/34a195fa1216482983d3b44bd5942ee1/users/6474d8fde0a648a58ae6bff95bf7edb7/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:39.301243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebbe5b44ae2414cbf2ccf948e001551', 'request_id': 'req-fac45d45-4e9f-4610-bd36-732c4d625cbd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.301466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.301847 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.302230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.313419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebbe5b44ae2414cbf2ccf948e001551', 'request_id': 'req-fac45d45-4e9f-4610-bd36-732c4d625cbd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.324420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebbe5b44ae2414cbf2ccf948e001551', 'request_id': 'req-fac45d45-4e9f-4610-bd36-732c4d625cbd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.346468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] The token cache is being invalidate because project 0ebbe5b44ae2414cbf2ccf948e001551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:39.346757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.347633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fac45d45-4e9f-4610-bd36-732c4d625cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.349177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] MFA Rules not processed for user `6474d8fde0a648a58ae6bff95bf7edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:39.349298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1057/2108] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:39 2022] DELETE /identity/v3/projects/0ebbe5b44ae2414cbf2ccf948e001551 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:39.350526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.354591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece1d0-3777-41f2-98f9-76700add9e0a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.354903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece1d0-3777-41f2-98f9-76700add9e0a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.355592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abece1d0-3777-41f2-98f9-76700add9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.381840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-abece1d0-3777-41f2-98f9-76700add9e0a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:39.383797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-abece1d0-3777-41f2-98f9-76700add9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.467675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1052/2109] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:39.475677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.476582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1058/2110] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:39.477337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.484876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.485350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.485686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.513341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:39.514716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.525831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1059/2111] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:39.530911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.550884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44746140-18e1-4b1c-9789-5eaae62db4e8 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.553634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1a52a-22c8-4f50-9dd6-28d19abec6b3 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.556480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.557285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.557566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.558433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.558953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.559123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:39.559565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.560102 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.560580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.561297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.561679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.569661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:39.574388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.576178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.580918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1060/2112] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:39.586537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.593305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1053/2113] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:39.613765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337facc-2a5f-4d5b-bfd9-efcf332445a0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.628171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.628779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.630614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.631023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.631958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.634288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.637912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.639373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.656047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bead-11ce-419d-9cda-2ac1d114c315 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.659056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.659708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.660549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.660549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] PATH_INFO: `/v3/users/6474d8fde0a648a58ae6bff95bf7edb7` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.661894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6474d8fde0a648a58ae6bff95bf7edb7)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.664036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.673053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1061/2114] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:39.677468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.736866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6474d8fde0a648a58ae6bff95bf7edb7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.738324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6474d8fde0a648a58ae6bff95bf7edb7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.739182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6474d8fde0a648a58ae6bff95bf7edb7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.749740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:39.762177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6474d8fde0a648a58ae6bff95bf7edb7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.776853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-73bd5181-00b3-4558-b2df-fede57a7125e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6474d8fde0a648a58ae6bff95bf7edb7'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:39.788887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b6657-9cfc-4e0c-b8c6-2134abd93f21 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.793908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.794529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.794810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.795082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.796093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.797167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1054/2115] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:39 2022] DELETE /identity/v3/users/6474d8fde0a648a58ae6bff95bf7edb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:39.798441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.806076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.806822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.811037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.824859 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1062/2116] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:39.828663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.830385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.836606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:39.838032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.847218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42558666-f4af-4f89-a0e6-b1de1d9bd298 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.921375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1055/2117] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:39.937230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.937230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:39.940461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.941110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.941390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.941662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.942357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.944058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.955061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1063/2118] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:39.959094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:39.972582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2f39-64e4-4118-8f9d-6f2c2161d5d7 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:39.977952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:39.978580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:39.978857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:39.979129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:39.979781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:39.981625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:39.997279 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1064/2119] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:40.002494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.020167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297e91c-635a-4f51-aad5-86ca7b49b16b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.028977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.030220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.030744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.031273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] PATH_INFO: `/v3/projects/dc92f979d76d470e87d6d753149b815f/users/e527783f3d3741d1b85f02bfca301547/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.042208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477a55-7699-407c-8e40-be7f30ac2b5c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.049013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.050024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.050464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.050888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.057855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc92f979d76d470e87d6d753149b815f, user_id=e527783f3d3741d1b85f02bfca301547, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.062931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca571-1294-4058-a92d-91304c113fee admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.067051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.070027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.078854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1065/2120] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:40 2022] PUT /identity/v3/projects/dc92f979d76d470e87d6d753149b815f/users/e527783f3d3741d1b85f02bfca301547/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:40.084226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1056/2121] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:40.091773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.092382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.092833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.126924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] MFA Rules not processed for user `e527783f3d3741d1b85f02bfca301547`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:40.128463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.149549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:40.236837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1066/2122] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:40.241517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.265806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69bd14-aabd-4d47-b2eb-57c3f4baad5b service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.328043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.328664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.329035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.329251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.329879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.331804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.366159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1057/2123] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:40.367460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.377025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.379815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.380182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982147b-2192-4b53-88e9-94bbc831951e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.383703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:40.454136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.454759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.455069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.455342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.455973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.458430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.459199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab5cb-49e1-49fa-8512-ad51d8810620 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.463672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.464251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.464533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.464787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] PATH_INFO: `/v3/projects/34a195fa1216482983d3b44bd5942ee1` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.465949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a195fa1216482983d3b44bd5942ee1)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.468242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.488887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1067/2124] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:40.492792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.503420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0785a0-473d-4564-9dc1-2e2bd6e340e9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.508974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.509241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.509515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.509793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.510434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.512702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.523998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1068/2125] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:40.528215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.531970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a195fa1216482983d3b44bd5942ee1', 'request_id': 'req-5e4bc665-433c-4f33-976c-41a7038ebf39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.539133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b0ff-a85f-4ae4-9b8d-e5440e25e9d1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.543008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a195fa1216482983d3b44bd5942ee1', 'request_id': 'req-5e4bc665-433c-4f33-976c-41a7038ebf39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.551147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a195fa1216482983d3b44bd5942ee1', 'request_id': 'req-5e4bc665-433c-4f33-976c-41a7038ebf39'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.562588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] The token cache is being invalidate because project 34a195fa1216482983d3b44bd5942ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:40.562878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.563551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5e4bc665-433c-4f33-976c-41a7038ebf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.565253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1058/2126] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:40 2022] DELETE /identity/v3/projects/34a195fa1216482983d3b44bd5942ee1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:40.571524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.572099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.572495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.595199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:40.596407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.603261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.603930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.604233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.604502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] PATH_INFO: `/v3/projects/3b326362f83340b2b7a716e588625885/users/d125edbace994d29b42d032e17091a0e/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.608041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1059/2127] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:40.608874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.615466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.619738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b326362f83340b2b7a716e588625885, user_id=d125edbace994d29b42d032e17091a0e, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.622436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e83f-8492-4256-82bc-36cee167a226 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.627780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a012-2823-4c7f-8f20-aa3886d38c78 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.633814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.634458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.634739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.635005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] PATH_INFO: `/v3/users/4c08afe86633459eb664a86b7db349b2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.636810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c08afe86633459eb664a86b7db349b2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.638244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1069/2128] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:40 2022] PUT /identity/v3/projects/3b326362f83340b2b7a716e588625885/users/d125edbace994d29b42d032e17091a0e/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:40.642082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.642170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.642170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.642170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.659202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:40.660529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.675856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:40.693051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c08afe86633459eb664a86b7db349b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.693747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c08afe86633459eb664a86b7db349b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.694362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c08afe86633459eb664a86b7db349b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.710953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c08afe86633459eb664a86b7db349b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.721307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c08afe86633459eb664a86b7db349b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:40.731845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1070/2129] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:40.736499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.737077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:40.738317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.747317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1060/2130] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:40 2022] DELETE /identity/v3/users/4c08afe86633459eb664a86b7db349b2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:40.747317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.755345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006c70-f331-4d83-9735-b51b99476503 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.819879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.820535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.820884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.821093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.821788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.823552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.824781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53b540-b768-4099-bd68-f1f61678c898 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.829744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.830716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.830997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.831269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.832003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:40.832236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.833994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b21820-8681-4be7-b06a-cffc120ce7d5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.846924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1061/2131] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:40.847799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1071/2132] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:40.848411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.848752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.849142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.851513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.861990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8485c-3641-49f8-b803-ed106e63333f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.867184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.867613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:40.867789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.868066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.868335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.868803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.868997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.870911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.876501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1062/2133] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:40.877331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.886621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f274358-23bc-49de-8130-e0808f44b1f7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.891895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.892563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.892827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.893258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] PATH_INFO: `/v3/projects/3b326362f83340b2b7a716e588625885/users/d125edbace994d29b42d032e17091a0e/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.895788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b326362f83340b2b7a716e588625885, user_id=d125edbace994d29b42d032e17091a0e, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:40.898943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:40.909171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1072/2134] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:40.909171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.909171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:40.909839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1063/2135] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:40 2022] PUT /identity/v3/projects/3b326362f83340b2b7a716e588625885/users/d125edbace994d29b42d032e17091a0e/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:40.919539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:40.967523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926071ff-745e-4a6e-b18d-f721f44eba54 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:40.972200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:40.972842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:40.973154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:40.973424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:40.989037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d131-f77a-41ae-84c3-961abf2df1a6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.031797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:41.054812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.056316 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29dfa-9885-4f45-9852-95b2c8c288f4 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.057053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.057902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.058112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.058388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.059195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.061415 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.081768 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1073/2136] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:41.083416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.083631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.083898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.090484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1064/2137] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:40 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:41.095037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.106280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788be8-9e15-4b3d-8806-dbb5cfa0d19a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.111807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.112428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.112787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.114146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.114146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.115530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.117949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:41.118650 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] MFA Rules not processed for user `d125edbace994d29b42d032e17091a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:41.120034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.128741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1065/2138] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:41.133341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.145720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25da99a-7463-4b26-9897-56aae480d499 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.151614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.152267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.152989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.153266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.153963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.156373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.169141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1066/2139] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:41.174070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.185383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a61741-bb2f-4a84-aa4b-047ba375bd65 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.192833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.193563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.194229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.194229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] PATH_INFO: `/v3/projects/ab0845fc23654caaa4d55233986dbe44/users/4f72fbc2c4ee4f949d836ab4f4ee6ddc/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.210753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0845fc23654caaa4d55233986dbe44, user_id=4f72fbc2c4ee4f949d836ab4f4ee6ddc, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.213554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49883ab1-e36c-4ff8-8dc1-975cbc6d11ab admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.215506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1074/2140] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:41.227711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.229308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.234677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1067/2141] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:41 2022] PUT /identity/v3/projects/ab0845fc23654caaa4d55233986dbe44/users/4f72fbc2c4ee4f949d836ab4f4ee6ddc/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:41.245894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.246172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.246441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.282798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] MFA Rules not processed for user `4f72fbc2c4ee4f949d836ab4f4ee6ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:41.284557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.309483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848ab3-1cbc-4747-a5f9-da36841d8704 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.361337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1068/2142] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:41.370861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.372026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.372369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.372480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.372793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.373857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.374873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.386984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68ae46-1536-4d6b-aca3-8f8a2f018e5c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.392718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.393974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.394544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.394707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.406228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.407722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.417407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1069/2143] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:41.418892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:41.426243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.428254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:41.457900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.459520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.469596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1075/2144] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:41.501412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383334a-0140-4578-9433-8f957a4f8010 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.507174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.508367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.508784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.509441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] PATH_INFO: `/v3/projects/2435f8e526cb4e15b63919090f7a07c3` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.511349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2435f8e526cb4e15b63919090f7a07c3)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.513672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.567427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:41.578255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2435f8e526cb4e15b63919090f7a07c3', 'request_id': 'req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.589317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2435f8e526cb4e15b63919090f7a07c3', 'request_id': 'req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.597261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2435f8e526cb4e15b63919090f7a07c3', 'request_id': 'req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.609818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] The token cache is being invalidate because project 2435f8e526cb4e15b63919090f7a07c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:41.610179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.610904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.612936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1070/2145] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:41 2022] DELETE /identity/v3/projects/2435f8e526cb4e15b63919090f7a07c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:41.617094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:41.630995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d3004-d69b-4f68-be4e-8b4ac45ec6cc service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:41.710009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:41.710888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:41.711057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:41.711360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] PATH_INFO: `/v3/users/4a0c8c98e5054aa8a23c0f3067319d39` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:41.712670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0c8c98e5054aa8a23c0f3067319d39)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:41.714970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:41.801177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0c8c98e5054aa8a23c0f3067319d39'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.802357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0c8c98e5054aa8a23c0f3067319d39'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.803254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0c8c98e5054aa8a23c0f3067319d39'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.818050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0c8c98e5054aa8a23c0f3067319d39'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.827346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c044fe01-b881-47d2-90d4-edc9e282374b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0c8c98e5054aa8a23c0f3067319d39'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:41.843454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1076/2146] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:41 2022] DELETE /identity/v3/users/4a0c8c98e5054aa8a23c0f3067319d39 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:42.142298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.143841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:42.158019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd963e-c0c1-4d3d-bcd2-dbbfdc0cebb9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.232771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.233528 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.233802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.234094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] PATH_INFO: `/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.235253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a0124d1aa84294aa6a4ad3b6d205fd)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.237196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.290741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a0124d1aa84294aa6a4ad3b6d205fd', 'request_id': 'req-edcbbd03-9b41-48eb-a0c1-add336e350bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:42.300067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a0124d1aa84294aa6a4ad3b6d205fd', 'request_id': 'req-edcbbd03-9b41-48eb-a0c1-add336e350bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:42.306784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a0124d1aa84294aa6a4ad3b6d205fd', 'request_id': 'req-edcbbd03-9b41-48eb-a0c1-add336e350bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:42.317975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] The token cache is being invalidate because project 49a0124d1aa84294aa6a4ad3b6d205fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:42.318265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:42.318909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-edcbbd03-9b41-48eb-a0c1-add336e350bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:42.320485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1071/2147] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:42 2022] DELETE /identity/v3/projects/49a0124d1aa84294aa6a4ad3b6d205fd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:42.326535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.326852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.327118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.347539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:42.348676 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:42.403897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:42.416216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1077/2148] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:42.424183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.424503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.424810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.446317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:42.447537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:42.456548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1072/2149] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:42.461297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.472336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b6e8-215d-42b1-8db9-d729486e84d8 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.478660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.479335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.479672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.479870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.480637 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:42.480996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.482688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.495636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1078/2150] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:42.500743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.513869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5253b-a975-4868-804c-e6482ec9e837 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.520222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.520955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.521232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.521499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.522152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.524065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.558453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1073/2151] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:42.563794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.574185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee92b-aad8-460f-a616-555e02e935a4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.632944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.633496 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.633775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.634073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.634699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.636685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.663537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1079/2152] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:42.667988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.678612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a4c3-2275-4695-99c6-9dcca4cfae3e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.685057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.685662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.685938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.686205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.686843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.688576 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.698774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1074/2153] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:42.702979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.713532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ec3c1-3ad7-4f32-a7dd-0a49027c5f07 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.720375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.721152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.721434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.721695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.722349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.723977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd91645-db16-4bea-8cb5-3b3cc2505861 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.736753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1080/2154] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:42.740524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.750820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3d1e8-2fa0-4ff9-8f06-80cdfe988d8c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:42.756648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:42.757335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.757611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.757882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] PATH_INFO: `/v3/projects/36ebf69928104229a466eafb0e72edce/users/bb15603e44024f37ba926f73f88b3e05/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.776422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ebf69928104229a466eafb0e72edce, user_id=bb15603e44024f37ba926f73f88b3e05, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:42.779237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5579307-a8e6-4c27-b36d-68c8a35eb26a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:42.783250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:42.800737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1075/2155] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:42 2022] PUT /identity/v3/projects/36ebf69928104229a466eafb0e72edce/users/bb15603e44024f37ba926f73f88b3e05/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:42.817129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.817129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.817129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.830637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:42.830913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:42.831184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:42.845343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] MFA Rules not processed for user `bb15603e44024f37ba926f73f88b3e05`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:42.846590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:42.851401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] MFA Rules not processed for user `4f72fbc2c4ee4f949d836ab4f4ee6ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:42.852672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:42.918682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1081/2156] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:42.924607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:42.925160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1076/2157] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:42.988952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:43.010157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5107d-b880-4e0f-95dc-6d533c19dc6b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.015893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.016721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.017047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.017320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.018155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.020463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.060955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1082/2158] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:42 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:43.063709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.078211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a63d4a-133e-4c8e-8b80-f688dae8361b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.153642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.154751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.154751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.154949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.155475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.157942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.185200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1077/2159] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:43 2022] POST /identity/v3/users => generated 307 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:46:43.189508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.227142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac249cb5-7584-4907-aa46-2e1619642ff1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.232891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.233540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.233924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.234202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.235116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.236787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.248025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1083/2160] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:43.252496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.263797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bd8f-eeaa-4b2b-8b4e-7133db35e0ae admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.270988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.271845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.272185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.272536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] PATH_INFO: `/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41/users/33dc3ffbcdc242909545be50134786df/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.289380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8698ee2f45fc4d1088d11da2bcfdfe41, user_id=33dc3ffbcdc242909545be50134786df, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.292466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.294263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.296195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.311609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850dfde-0ac6-4a2d-aa6a-2f86fcdd0876 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.317146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.317802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.318060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.318322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] PATH_INFO: `/v3/users/bcf7a2f5de224a19988f140924f200ea` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.319464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf7a2f5de224a19988f140924f200ea)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.321448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.328240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1078/2161] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:43 2022] PUT /identity/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41/users/33dc3ffbcdc242909545be50134786df/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:43.332018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.376110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf7a2f5de224a19988f140924f200ea'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:43.376986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf7a2f5de224a19988f140924f200ea'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:43.377826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf7a2f5de224a19988f140924f200ea'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:43.394105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf7a2f5de224a19988f140924f200ea'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:43.405486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b772a5-df89-4247-930d-c3a57c8eecbb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.406375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-865fc344-db61-4694-b8ad-47bcffa8a24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf7a2f5de224a19988f140924f200ea'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:43.411329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.411954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.412242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.412507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.413190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.414904 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.425287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1084/2162] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:43 2022] DELETE /identity/v3/users/bcf7a2f5de224a19988f140924f200ea => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:43.430477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.430957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.431413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.433843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1079/2163] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:43.438114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.443975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.454578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:43.455845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.460103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:43.474428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48911a-ad05-4644-955c-ca864445abd6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.521749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1085/2164] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:43.531802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.533453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.573424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.574501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.575006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.575473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] PATH_INFO: `/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41/users/33dc3ffbcdc242909545be50134786df/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.578803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8698ee2f45fc4d1088d11da2bcfdfe41, user_id=33dc3ffbcdc242909545be50134786df, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.580764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:43.584314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacadf8-7c16-430f-a3b9-0745e5870751 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.596866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffba4-5fc6-44e2-ae54-40ed7194d4d0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.602820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1080/2165] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:43 2022] PUT /identity/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41/users/33dc3ffbcdc242909545be50134786df/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:43.614492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.614898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.615081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.649217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] MFA Rules not processed for user `33dc3ffbcdc242909545be50134786df`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:43.650420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.665292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.666001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.666568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.666847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.736771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1081/2166] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:43.751882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.753575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:43.782065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.784831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.810704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1086/2167] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:43.827125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd3afc-3121-4b9f-90ed-84130b998f9b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.831755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.832539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.832935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.833322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.843260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:43.845179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:43.866181 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1082/2168] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:46:43.940232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:43.953051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb908b3-92eb-42d8-bc73-b2e63f6ff0ae service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:43.957280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:43.959230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:43.960012 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:43.960343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:43.962305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.041953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:44.043356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:44.052860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1087/2169] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:44.108548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:44.110267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.128130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26101-282d-4852-8b3c-8ca10a4644a0 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:44.135918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:44.137407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:44.138198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:44.138382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:44.138532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] PATH_INFO: `/v3/projects/a4702835adcd458db69e30ef89263796` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:44.140469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.140671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4702835adcd458db69e30ef89263796)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:44.143036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:44.165687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36493cd5-04fe-4b35-a89a-34584f53d5cd service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:44.172871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:44.173675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:44.174098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:44.174505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] PATH_INFO: `/v3/users/e527783f3d3741d1b85f02bfca301547` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:44.175702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e527783f3d3741d1b85f02bfca301547)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:44.177783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:44.179206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:44.240335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4702835adcd458db69e30ef89263796', 'request_id': 'req-72e408cf-b3d4-479b-8014-21382bb644f3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.242675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:44.255682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e527783f3d3741d1b85f02bfca301547'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.257749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e527783f3d3741d1b85f02bfca301547'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.258662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4702835adcd458db69e30ef89263796', 'request_id': 'req-72e408cf-b3d4-479b-8014-21382bb644f3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.259581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e527783f3d3741d1b85f02bfca301547'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.268592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4702835adcd458db69e30ef89263796', 'request_id': 'req-72e408cf-b3d4-479b-8014-21382bb644f3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.287950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] The token cache is being invalidate because project a4702835adcd458db69e30ef89263796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:44.288930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.289980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e527783f3d3741d1b85f02bfca301547'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.292990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.298345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1083/2170] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:44 2022] DELETE /identity/v3/projects/a4702835adcd458db69e30ef89263796 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:44.299933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:44.304439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.306985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6de7f5a5-e2a1-456c-9117-052f3c9f760c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e527783f3d3741d1b85f02bfca301547'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.326300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1088/2171] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:44 2022] DELETE /identity/v3/users/e527783f3d3741d1b85f02bfca301547 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:44.331510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:44.331874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:44.332325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:44.357777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:44.359191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.418441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e408cf-b3d4-479b-8014-21382bb644f3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:44.435884 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1089/2172] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:44.449802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:44.451767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:44.534958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:44.535695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:44.536020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:44.536134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] PATH_INFO: `/v3/users/0cdc6a27fbfa4aab8f2eebe955cb9b02` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:44.537442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdc6a27fbfa4aab8f2eebe955cb9b02)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:44.539377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:44.575417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f85a-5db6-4ed5-b7c9-afbbfb48c9cd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:44.581698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:44.586485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:44.586485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:44.586485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:44.599408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:44.602600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:44.608720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdc6a27fbfa4aab8f2eebe955cb9b02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.609800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdc6a27fbfa4aab8f2eebe955cb9b02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.610481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdc6a27fbfa4aab8f2eebe955cb9b02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.615559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1090/2173] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:44.620113 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:44.627348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdc6a27fbfa4aab8f2eebe955cb9b02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.637504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdc6a27fbfa4aab8f2eebe955cb9b02'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:44.651804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1084/2174] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:44 2022] DELETE /identity/v3/users/0cdc6a27fbfa4aab8f2eebe955cb9b02 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:44.998323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:45.007441 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.057890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da27cc2-858b-4f99-bc4e-092a748d8bfe service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:45.149368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:45.150018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.150289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.150555 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] PATH_INFO: `/v3/projects/dc92f979d76d470e87d6d753149b815f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.151704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc92f979d76d470e87d6d753149b815f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:45.153912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:45.155451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.232694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc92f979d76d470e87d6d753149b815f', 'request_id': 'req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.250216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc92f979d76d470e87d6d753149b815f', 'request_id': 'req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.258548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc92f979d76d470e87d6d753149b815f', 'request_id': 'req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.270836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] The token cache is being invalidate because project dc92f979d76d470e87d6d753149b815f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:45.271123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.271820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.273656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1091/2175] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:44 2022] DELETE /identity/v3/projects/dc92f979d76d470e87d6d753149b815f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:45.277599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:45.279040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.292813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb182f-eaf6-4dbd-aa18-79b376469350 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:45.353478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:45.354166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.354441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.354713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] PATH_INFO: `/v3/users/d125edbace994d29b42d032e17091a0e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.355871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d125edbace994d29b42d032e17091a0e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:45.357869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:45.409268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd125edbace994d29b42d032e17091a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.409922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd125edbace994d29b42d032e17091a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.410670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd125edbace994d29b42d032e17091a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.424192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd125edbace994d29b42d032e17091a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.433855 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f0ab4260-1bf4-4b19-a764-3d33cc54383d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd125edbace994d29b42d032e17091a0e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.447042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1085/2176] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:45 2022] DELETE /identity/v3/users/d125edbace994d29b42d032e17091a0e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:45.489506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:45.491465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.508216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe226146-e4f5-4f3c-aa7c-b97d61b7fe42 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:45.588873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:45.590262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.590262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.590262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] PATH_INFO: `/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.591579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa7f81b5c554e48baa2522a3cb074f8)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:45.593706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:45.698385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa7f81b5c554e48baa2522a3cb074f8', 'request_id': 'req-e5befa5a-969c-4939-8972-ba3a8f7d5289'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.710557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa7f81b5c554e48baa2522a3cb074f8', 'request_id': 'req-e5befa5a-969c-4939-8972-ba3a8f7d5289'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.720614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa7f81b5c554e48baa2522a3cb074f8', 'request_id': 'req-e5befa5a-969c-4939-8972-ba3a8f7d5289'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.733747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] The token cache is being invalidate because project 9aa7f81b5c554e48baa2522a3cb074f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:45.734144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.734894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e5befa5a-969c-4939-8972-ba3a8f7d5289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:45.736714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1092/2177] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:45 2022] DELETE /identity/v3/projects/9aa7f81b5c554e48baa2522a3cb074f8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:45.742533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.743192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.743561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.766154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:45.767623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.842105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.863703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1086/2178] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:45.870413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.870869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.871140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.904256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:45.905540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.920579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1093/2179] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:45.922592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:45.924159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:45.932437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:45.938917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722be3b-318c-4c3e-a239-849dd51859c0 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:45.947413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:45.948593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.949010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.949446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] PATH_INFO: `/v3/projects/3b326362f83340b2b7a716e588625885` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.952352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b326362f83340b2b7a716e588625885)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:45.955076 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:45.955600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98462f-4d30-4139-9881-afbeefac85c4 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:45.960827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:45.962153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:45.962494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:45.962824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:45.963731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:45.964086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:45.965988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:45.977698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:45.984969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1094/2180] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:46:45.988731 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.000306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375535-cd9d-4a22-97bd-9c46881b989c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.006888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.007762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.008038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.008447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.009499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.013055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.027082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b326362f83340b2b7a716e588625885', 'request_id': 'req-38930f54-d525-4db6-99cc-82ba79141364'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:46.053552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b326362f83340b2b7a716e588625885', 'request_id': 'req-38930f54-d525-4db6-99cc-82ba79141364'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:46.061360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1095/2181] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:45 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:46.063016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.067761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b326362f83340b2b7a716e588625885', 'request_id': 'req-38930f54-d525-4db6-99cc-82ba79141364'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:46.101013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] The token cache is being invalidate because project 3b326362f83340b2b7a716e588625885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:46.101013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:46.105078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-38930f54-d525-4db6-99cc-82ba79141364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:46.107106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1087/2182] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:45 2022] DELETE /identity/v3/projects/3b326362f83340b2b7a716e588625885 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:46.112320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.112961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.113469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.137445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:46.138981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.188553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e90d9-e990-4d95-a53c-81de40af4992 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.194361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.195618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.196062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.196437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.197144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.199612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80092c-c103-4980-a1c4-4972689b23fe admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.228369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1088/2183] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:46.230308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1096/2184] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:46.234456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.235780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.236113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.236227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.236417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.249566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20590fb-ee9f-4558-968b-b7164a54c720 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.255603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.256269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.256546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.256813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.257746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.257992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:46.259405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.259548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.270379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1097/2185] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:46.272035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1089/2186] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:46.274254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.275821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.285707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180d703-37ae-4282-9842-ce41e2a970a3 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.287712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51602e99-f0ab-4c43-9fc7-fd7ad01344c7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.291476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.292111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.292406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.292656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.292986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.293353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:46.293647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.293750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.293967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.294238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.294883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.295282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.296472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.310032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1090/2187] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:46:46.313210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1098/2188] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:46.314013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.314135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.324303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e413-385e-4d7a-b007-ac506d15cdb7 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.324520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414b491-66f5-4182-adf2-005ba25f29ca admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.329499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.329657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.330105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.330274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.330379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.330548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.330796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.330905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] PATH_INFO: `/v3/projects/c9443b9cb01544cea42892d2b45729df/users/eedbacabe11c47a09795563e7b437ac1/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.331489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.333524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c703239-5ea7-4303-a6e8-576555c42edf admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.347664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9443b9cb01544cea42892d2b45729df, user_id=eedbacabe11c47a09795563e7b437ac1, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.350843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.378124 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1091/2189] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:46 2022] PUT /identity/v3/projects/c9443b9cb01544cea42892d2b45729df/users/eedbacabe11c47a09795563e7b437ac1/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:46.378372 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1099/2190] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/projects => generated 395 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:46.378477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.380651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.380772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.381187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.415296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] MFA Rules not processed for user `eedbacabe11c47a09795563e7b437ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:46.415980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:46.417745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.458340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbb631-c2ee-4542-9d25-0065093f0937 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.517619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1100/2191] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:46.530009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.533534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.546819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.547972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.548471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.549079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.549881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.551931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.558722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:46.598011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1092/2192] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:46.602103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.617130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c085a-33c3-424c-a544-d627cc1ae146 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.621608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.622406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.622680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.623514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.628523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86511f74-ea97-44e9-aa1c-33f353761d0d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.634261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.635337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.635945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.636996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.637844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.638143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.638862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.641726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.651186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1101/2193] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:46.659145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1093/2194] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:46.660638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.671476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49390844-1a77-4ced-b04e-f8dcd5973734 service glance] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.680744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.681477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.681971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.682273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.682920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.684541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16872b-587d-444b-b3eb-759af178e0b2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.698497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1102/2195] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:46.702484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.713810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57288e-a72d-4024-8de3-97ee8f06a7b2 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:46.721333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:46.722018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.722295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.722571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] PATH_INFO: `/v3/projects/08efaf8866eb4b71acca0b1f8926f5e6/users/9f56d0babf3d4f43b455f3a4348c7d3d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.746530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08efaf8866eb4b71acca0b1f8926f5e6, user_id=9f56d0babf3d4f43b455f3a4348c7d3d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:46.750633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:46.769919 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1094/2196] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:46 2022] PUT /identity/v3/projects/08efaf8866eb4b71acca0b1f8926f5e6/users/9f56d0babf3d4f43b455f3a4348c7d3d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:46.781324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:46.781611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:46.782250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:46.816079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] MFA Rules not processed for user `9f56d0babf3d4f43b455f3a4348c7d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:46.817488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.915539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1103/2197] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:46.930048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:46.931926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:46.999834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78621-2c13-4a2d-88f2-bdb9def22940 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:47.004215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:47.004849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:47.005159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:47.005429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:47.037499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:47.039365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2fe0-0f77-4a38-918c-9b2bb906fa6a service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:47.052560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1095/2198] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:48.744057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:48.745714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:48.837771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67f9e5-c4ef-4674-b69d-72368aecbc5d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:48.842806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:48.843475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:48.843800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:48.844255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] PATH_INFO: `/v3/users/bb15603e44024f37ba926f73f88b3e05` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:48.846601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb15603e44024f37ba926f73f88b3e05)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:48.848657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:48.896519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:48.904146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb15603e44024f37ba926f73f88b3e05'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:48.905090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb15603e44024f37ba926f73f88b3e05'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:48.905969 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb15603e44024f37ba926f73f88b3e05'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:48.919074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb15603e44024f37ba926f73f88b3e05'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:48.926317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb15603e44024f37ba926f73f88b3e05'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:48.945675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1104/2199] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:48 2022] DELETE /identity/v3/users/bb15603e44024f37ba926f73f88b3e05 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:48.951277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:48.951836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:48.951836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:48.984790 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:48.985489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:49.031960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:49.073397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1096/2200] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:46:49.083777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:49.085536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:49.151920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2fcc-d6b3-46cc-9b55-bcca95b80032 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:49.155875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:49.156519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:49.156798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:49.157129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:49.167338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:49.168842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:49.180400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1105/2201] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:49.660419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:49.662012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:49.675876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753a351-9a1f-43a0-8a4c-8c35dce5588b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:49.682168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:49.682892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:49.683169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:49.683439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] PATH_INFO: `/v3/projects/36ebf69928104229a466eafb0e72edce` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:49.684964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ebf69928104229a466eafb0e72edce)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:49.687010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:49.744363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ebf69928104229a466eafb0e72edce', 'request_id': 'req-6440ebef-fae7-438d-8e8a-3ea554c48470'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.753741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ebf69928104229a466eafb0e72edce', 'request_id': 'req-6440ebef-fae7-438d-8e8a-3ea554c48470'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.761237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ebf69928104229a466eafb0e72edce', 'request_id': 'req-6440ebef-fae7-438d-8e8a-3ea554c48470'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.775878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] The token cache is being invalidate because project 36ebf69928104229a466eafb0e72edce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:49.776225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.777407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.779933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1097/2202] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:49 2022] DELETE /identity/v3/projects/36ebf69928104229a466eafb0e72edce => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:49.784295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:49.796736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888d6b8-3419-473b-87d4-a780a7cd018b service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:49.858872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:49.859589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:49.859873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:49.860136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] PATH_INFO: `/v3/users/33dc3ffbcdc242909545be50134786df` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:49.861399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dc3ffbcdc242909545be50134786df)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:49.863481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:49.917414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dc3ffbcdc242909545be50134786df'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.918203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dc3ffbcdc242909545be50134786df'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.919423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dc3ffbcdc242909545be50134786df'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.931847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:49.933952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dc3ffbcdc242909545be50134786df'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.943213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a4677680-c904-4271-a835-3278d5dc3e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dc3ffbcdc242909545be50134786df'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:49.960369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1106/2203] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:49 2022] DELETE /identity/v3/users/33dc3ffbcdc242909545be50134786df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:50.250519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.252454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:50.269731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ebef-fae7-438d-8e8a-3ea554c48470 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.334574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.335604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.335725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.335934 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] PATH_INFO: `/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.337191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8698ee2f45fc4d1088d11da2bcfdfe41)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.339151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.389447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8698ee2f45fc4d1088d11da2bcfdfe41', 'request_id': 'req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:50.406778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8698ee2f45fc4d1088d11da2bcfdfe41', 'request_id': 'req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:50.416300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8698ee2f45fc4d1088d11da2bcfdfe41', 'request_id': 'req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:50.417587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:50.437305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] The token cache is being invalidate because project 8698ee2f45fc4d1088d11da2bcfdfe41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:50.438336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:50.439394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7ca0ead6-d731-466f-9319-d7a8a72aa9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:50.442321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1098/2204] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:50 2022] DELETE /identity/v3/projects/8698ee2f45fc4d1088d11da2bcfdfe41 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:46:50.455415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.456119 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.456344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.487143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:50.492114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:50.597486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1107/2205] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:50.611421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.611794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.612482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.637737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:50.639688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:50.653597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1099/2206] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:50.658176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.668169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66335819-fc8c-4b1b-a793-af2807784f63 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.676430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.677168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.677485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.677746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.678431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:46:50.678788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.683942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.695384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1108/2207] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:46:50.700301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.714340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f123-d25e-451c-942a-d01d9daf6e14 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.720886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.721550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.721823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.722088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.722732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.724723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.755995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1100/2208] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:46:50 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:50.760687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.772266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ec72-022f-491d-b4cb-cd7b73b6cf89 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.836628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.837395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.837568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.837835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.838632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.841037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.871171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1109/2209] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:46:50 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:46:50.878273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.891657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1baae12-0187-4424-8d25-59ea16854945 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.897116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.897801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.898459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.898459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.898985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.900637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.913276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1101/2210] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:50.920040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.940061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417960d-f970-41d0-8021-3321fc0d8ec3 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.948275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.948966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.949248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.949519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:50.950245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:50.951932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1452915-9094-41ee-b9b3-d6126d059c6a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:50.968143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1110/2211] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:46:50.969777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:50.984342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c90fb-6a24-4660-80f1-765f85799ea4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:50.992735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:50.993549 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:50.993929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:50.994269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] PATH_INFO: `/v3/projects/2813733edd584341bda16375226939cb/users/31ecd2ce84674e2e8d6dc394e035858c/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:51.012862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2813733edd584341bda16375226939cb, user_id=31ecd2ce84674e2e8d6dc394e035858c, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:51.016010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:51.036210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1102/2212] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:46:50 2022] PUT /identity/v3/projects/2813733edd584341bda16375226939cb/users/31ecd2ce84674e2e8d6dc394e035858c/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:51.046979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:51.047326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:51.047602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:51.092847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] MFA Rules not processed for user `31ecd2ce84674e2e8d6dc394e035858c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:51.094322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:51.138137 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:51.180937 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1111/2213] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:51.199589 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:51.203578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:51.295275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ddd9-3095-40bc-b95e-341adc66e40b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:51.300518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:51.301747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:51.302908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:51.303699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:51.317997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:51.320157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f306c-ad9c-495a-8f1a-26a9570a5876 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:51.334323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1103/2214] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:52.380754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:52.382674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:52.455703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d0c8d-7be6-4247-8eef-0d772d18d510 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:52.462408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:52.462946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:52.463217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:52.463489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] PATH_INFO: `/v3/users/9f56d0babf3d4f43b455f3a4348c7d3d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:52.464730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f56d0babf3d4f43b455f3a4348c7d3d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:52.466758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:52.523382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f56d0babf3d4f43b455f3a4348c7d3d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:52.524038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f56d0babf3d4f43b455f3a4348c7d3d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:52.524929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f56d0babf3d4f43b455f3a4348c7d3d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:52.539155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f56d0babf3d4f43b455f3a4348c7d3d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:52.548013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f56d0babf3d4f43b455f3a4348c7d3d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:52.565346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1112/2215] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:46:52 2022] DELETE /identity/v3/users/9f56d0babf3d4f43b455f3a4348c7d3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:46:52.571626 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:52.572287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:52.572839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:52.600710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:46:52.601962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:52.669656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1104/2216] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:46:52.679841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:52.681415 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:52.744739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604edb0-b21b-4c5c-b0e2-1713b3f02980 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:52.749378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:52.750005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:52.750283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:52.750551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:52.758568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:52.761531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:52.763447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1cf66-f493-457f-b915-1b22e6ac2b7f service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:52.778202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1113/2217] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:46:53.149238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:46:53.150722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:46:53.172056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782cbdd-9536-4f2d-b361-040183930504 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:46:53.185018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:46:53.185742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:46:53.186025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:46:53.186299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] PATH_INFO: `/v3/projects/08efaf8866eb4b71acca0b1f8926f5e6` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:46:53.187514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08efaf8866eb4b71acca0b1f8926f5e6)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:46:53.189756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:46:53.239281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:53.294006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08efaf8866eb4b71acca0b1f8926f5e6', 'request_id': 'req-4485d700-a45f-4cae-882c-0a706396e00e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:53.325766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08efaf8866eb4b71acca0b1f8926f5e6', 'request_id': 'req-4485d700-a45f-4cae-882c-0a706396e00e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:53.354962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08efaf8866eb4b71acca0b1f8926f5e6', 'request_id': 'req-4485d700-a45f-4cae-882c-0a706396e00e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:53.392746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] The token cache is being invalidate because project 08efaf8866eb4b71acca0b1f8926f5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:46:53.393103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:53.393822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:46:53.405169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1105/2218] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:46:53 2022] DELETE /identity/v3/projects/08efaf8866eb4b71acca0b1f8926f5e6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:01.124069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:01.124069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:01.124069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:01.138110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:01.139332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:01.205459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1114/2219] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:01.256304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:01.257809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:01.341720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485d700-a45f-4cae-882c-0a706396e00e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:01.348256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:01.348938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:01.349204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:01.349465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:01.367980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:01.370296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff19edb-51ed-461e-ae25-55a0b0ea2f4c service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:01.383905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1106/2220] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:01.913831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:01.915251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:01.991594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbab52-d8dc-43a1-a4f5-4333f864a2a2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:01.996382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:01.996924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:01.997407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:01.997694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] PATH_INFO: `/v3/users/31ecd2ce84674e2e8d6dc394e035858c` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:01.998898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ecd2ce84674e2e8d6dc394e035858c)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:02.000734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.001103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.001578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:02.002008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.020493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:02.021744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.029405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1107/2221] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:47:02.042907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:02.056245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ecd2ce84674e2e8d6dc394e035858c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.056725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997e76-fa42-4a24-a03c-e7874c2f2b5e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:02.056881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ecd2ce84674e2e8d6dc394e035858c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.057505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ecd2ce84674e2e8d6dc394e035858c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.061959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:02.062570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.062849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.063118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.065061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.070283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ecd2ce84674e2e8d6dc394e035858c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.077090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:02.078455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ecd2ce84674e2e8d6dc394e035858c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.078928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf4545-2755-423d-88f9-3049d2c24dd3 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:02.087771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1108/2222] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:02.092795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1115/2223] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:47:01 2022] DELETE /identity/v3/users/31ecd2ce84674e2e8d6dc394e035858c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:02.097277 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6e09-a8fb-4073-a83d-0e827ee19088 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.097568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6e09-a8fb-4073-a83d-0e827ee19088 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.097844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f6e09-a8fb-4073-a83d-0e827ee19088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.118087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a98f6e09-a8fb-4073-a83d-0e827ee19088 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:02.119309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a98f6e09-a8fb-4073-a83d-0e827ee19088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.194839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1109/2224] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:02.205101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:02.207992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.235621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:02.279745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d80e6-ca13-4406-9511-d7be5f1afae0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:02.288361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:02.289055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.289336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.289611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.303505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:02.305064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:02.315204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1116/2225] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:02.368009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.368521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.368614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.392826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:02.394104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.412653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:02.463744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1110/2226] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:02.478138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:02.480380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.554950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adbb4-4d73-4391-8beb-6c6769998469 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:02.560293 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:02.561051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.561330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.561601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.578382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:02.580608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805de64-ae27-482f-ab53-14073a02907f service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:02.592090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1117/2227] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:02.619268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:02.620697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:02.639157 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2e32d-87fe-42e8-b95b-1812b881def8 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:02.645867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:02.646755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:02.647029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:02.647687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] PATH_INFO: `/v3/projects/2813733edd584341bda16375226939cb` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:02.648943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2813733edd584341bda16375226939cb)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:02.652085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:02.711643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2813733edd584341bda16375226939cb', 'request_id': 'req-14b0fc45-a382-4600-943e-3d3b0d7fe828'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.721162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2813733edd584341bda16375226939cb', 'request_id': 'req-14b0fc45-a382-4600-943e-3d3b0d7fe828'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.728420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2813733edd584341bda16375226939cb', 'request_id': 'req-14b0fc45-a382-4600-943e-3d3b0d7fe828'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.745517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] The token cache is being invalidate because project 2813733edd584341bda16375226939cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:47:02.745758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.746433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:02.748086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1111/2228] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:47:02 2022] DELETE /identity/v3/projects/2813733edd584341bda16375226939cb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:03.039651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:03.039945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:03.040210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:03.066458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:03.068064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:03.135443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1118/2229] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:03.148966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:03.150607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:03.228942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0fc45-a382-4600-943e-3d3b0d7fe828 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:03.234497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:03.235112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:03.235384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:03.235650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:03.245257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:03.246918 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeeec8-e59b-4207-be26-103988244e50 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:03.255148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1112/2230] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:05.435914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:05.437500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:05.500590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:05.505400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8791-b264-4641-889c-03ca86f43135 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:05.510785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:05.511475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:05.511753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:05.512021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] PATH_INFO: `/v3/users/4f72fbc2c4ee4f949d836ab4f4ee6ddc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:05.513340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f72fbc2c4ee4f949d836ab4f4ee6ddc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:05.515853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:05.569451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f72fbc2c4ee4f949d836ab4f4ee6ddc'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:05.570134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f72fbc2c4ee4f949d836ab4f4ee6ddc'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:05.570770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f72fbc2c4ee4f949d836ab4f4ee6ddc'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:05.583322 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f72fbc2c4ee4f949d836ab4f4ee6ddc'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:05.590081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f72fbc2c4ee4f949d836ab4f4ee6ddc'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:05.603855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1119/2231] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:47:05 2022] DELETE /identity/v3/users/4f72fbc2c4ee4f949d836ab4f4ee6ddc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:05.608744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:05.609308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:05.609308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:05.631624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:05.633004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:05.669308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:05.698142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1113/2232] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:05.708532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:05.710255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:05.776108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd2619-851b-450b-89df-ac2c6ee06ed6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:05.780033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:05.780661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:05.780960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:05.781234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:05.790835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:05.792991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc3883-8ab2-4c4b-ae5d-884de3a83af5 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:05.803628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1120/2233] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:06.023533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:06.025158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:06.040863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e25c0-afe8-4f36-b46b-cbe7c585d22a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:06.047288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:06.048182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:06.048500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:06.048776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] PATH_INFO: `/v3/projects/ab0845fc23654caaa4d55233986dbe44` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:06.050121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0845fc23654caaa4d55233986dbe44)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:06.052147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:06.108437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0845fc23654caaa4d55233986dbe44', 'request_id': 'req-87a32b0f-51dc-46eb-8bca-7942da5ff56f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:06.117081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0845fc23654caaa4d55233986dbe44', 'request_id': 'req-87a32b0f-51dc-46eb-8bca-7942da5ff56f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:06.123639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0845fc23654caaa4d55233986dbe44', 'request_id': 'req-87a32b0f-51dc-46eb-8bca-7942da5ff56f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:06.134906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] The token cache is being invalidate because project ab0845fc23654caaa4d55233986dbe44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:47:06.135193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:06.135952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-87a32b0f-51dc-46eb-8bca-7942da5ff56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:06.137645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1114/2234] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:47:06 2022] DELETE /identity/v3/projects/ab0845fc23654caaa4d55233986dbe44 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:11.948655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:11.950098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:11.950775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:11.985704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] MFA Rules not processed for user `76c00cbffad2450e8b95a7df7725fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:11.988159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:12.125233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1121/2235] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:13.559281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb987db-2f5a-451b-ab0a-eb1e339b3757 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:13.559800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb987db-2f5a-451b-ab0a-eb1e339b3757 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:13.559901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb987db-2f5a-451b-ab0a-eb1e339b3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:13.582519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9cb987db-2f5a-451b-ab0a-eb1e339b3757 None None] MFA Rules not processed for user `88dab4e4b3904ca4a97d44597619dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:13.583907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9cb987db-2f5a-451b-ab0a-eb1e339b3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:13.647183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1115/2236] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:15.213434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:15.215755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:15.251202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:15.300670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9092be-4b3e-4459-bfab-bd224b1c1016 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:15.306259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:15.306992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:15.307274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:15.307579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] PATH_INFO: `/v3/users/eedbacabe11c47a09795563e7b437ac1` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:15.308875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedbacabe11c47a09795563e7b437ac1)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:15.311317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:15.378062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedbacabe11c47a09795563e7b437ac1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:15.378802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedbacabe11c47a09795563e7b437ac1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:15.379407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedbacabe11c47a09795563e7b437ac1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:15.398848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedbacabe11c47a09795563e7b437ac1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:15.407264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedbacabe11c47a09795563e7b437ac1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:15.449016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1122/2237] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:47:15 2022] DELETE /identity/v3/users/eedbacabe11c47a09795563e7b437ac1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:15.450333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:15.450884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:15.450884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:15.472881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:15.474082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:15.605863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1116/2238] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:15.622456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:15.626662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:15.720155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f857b-a844-4d0f-83af-71cb2ca68d17 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:15.725513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:15.726396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:15.726791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:15.727164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:15.749583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:15.753803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9b21b-44ee-4b06-84bd-15f1cb8cb80d service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:15.767962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1123/2239] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:47:16.465420 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:16.467074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:16.485443 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66b0d-2b56-48ba-abff-0170adadac80 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:16.494185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:16.495182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:16.495646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:16.496088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] PATH_INFO: `/v3/projects/c9443b9cb01544cea42892d2b45729df` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:16.497395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9443b9cb01544cea42892d2b45729df)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:16.499377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:16.502931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:16.569202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9443b9cb01544cea42892d2b45729df', 'request_id': 'req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:16.582477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9443b9cb01544cea42892d2b45729df', 'request_id': 'req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:16.591649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9443b9cb01544cea42892d2b45729df', 'request_id': 'req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:16.604541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] The token cache is being invalidate because project c9443b9cb01544cea42892d2b45729df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:47:16.605123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:16.606191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-6ba63bd8-4243-47b2-9b0b-b413fdb65c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:16.608303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1117/2240] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:47:16 2022] DELETE /identity/v3/projects/c9443b9cb01544cea42892d2b45729df => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:16.613667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:16.616365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:16.616861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:16.671125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:16.672600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:16.740934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:16.781551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1124/2241] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:16.783085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:16.783877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:16.784151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:16.818900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:16.819518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:16.839058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:16.849899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1118/2242] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:47:16.851091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047621-f0d3-4b14-a62b-7fba7bde1805 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:16.858341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:16.859225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:16.860148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:16.860494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:16.861345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:47:16.861777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:16.863522 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:16.880406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1125/2243] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:47:16.881993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:16.893916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8463b5-7bb8-4eef-8453-21845226878b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:16.899845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:16.900618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:16.901031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:16.901418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:16.902166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:16.904347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:16.945975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1119/2244] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:47:16 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:47:16.949949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:16.963088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba87ca-c1af-4911-bc56-5e9295bca45e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:17.094797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:17.097732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.097732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.097732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.099005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:17.102098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:17.132974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1126/2245] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:47:16 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:47:17.136933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:17.150269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611102fe-2d57-4e18-9260-51201b157b66 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:17.155633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:17.156264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.156551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.156826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.157841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:17.159869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:17.176502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1120/2246] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:47:17.181129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:17.193825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28891ca0-318a-4f66-a903-24db7a3646b1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:17.201988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:17.202821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.203228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.203599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.204359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:17.209117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac640d-1747-44ed-8885-ca4985b73553 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:17.222236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1127/2247] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:47:17.228430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:17.240929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6371305-4a62-4d3a-9427-bd081f8a661d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:17.246607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:17.247311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.247587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.247860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] PATH_INFO: `/v3/projects/15fbf21dacd44fb59ed417aa0e44a72e/users/8f0466f35a514370873724c729a90352/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.269678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fbf21dacd44fb59ed417aa0e44a72e, user_id=8f0466f35a514370873724c729a90352, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:17.273168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:17.298881 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1121/2248] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:47:17 2022] PUT /identity/v3/projects/15fbf21dacd44fb59ed417aa0e44a72e/users/8f0466f35a514370873724c729a90352/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:17.309839 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e3a5-2157-4e33-af85-a2013f61595d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.310116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e3a5-2157-4e33-af85-a2013f61595d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.310382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4e3a5-2157-4e33-af85-a2013f61595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.340772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-49a4e3a5-2157-4e33-af85-a2013f61595d None None] MFA Rules not processed for user `8f0466f35a514370873724c729a90352`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:17.342118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-49a4e3a5-2157-4e33-af85-a2013f61595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:17.417814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1128/2249] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:17.430649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:17.432687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:17.495684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30c7a6-4fdc-4002-8fbb-91c9c3062e73 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:17.500336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:17.500996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:17.501280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:17.502207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:17.512442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:17.513925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:17.523944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1122/2250] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:24.108060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497041-3011-46da-9944-29c7097c8c12 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:24.108577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497041-3011-46da-9944-29c7097c8c12 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:24.108577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497041-3011-46da-9944-29c7097c8c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:24.129747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f8497041-3011-46da-9944-29c7097c8c12 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:24.130782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f8497041-3011-46da-9944-29c7097c8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:24.182843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:24.211158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1129/2251] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:24.235454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:24.237611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:24.279990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:24.321372 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b085771-7c35-41c5-bac9-8003e8039539 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:24.326740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:24.327365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:24.327645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:24.327913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:24.337496 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:24.339123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4658-f2d3-4e11-aa63-fe80afdaa9c0 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:24.348248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1123/2252] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:34.204225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:34.344310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=18 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:42.164250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.164944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.164944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.166365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1130/2253] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:42.172868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5797ce-7dd3-407c-a7a4-5a760797f5a4 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.173456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5797ce-7dd3-407c-a7a4-5a760797f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.173750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5797ce-7dd3-407c-a7a4-5a760797f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.198032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-7d5797ce-7dd3-407c-a7a4-5a760797f5a4 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:42.199276 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7d5797ce-7dd3-407c-a7a4-5a760797f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.281132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1124/2254] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:42.293312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.295280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.359469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412939f3-bea7-4acf-be81-5e58f388a9e0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.363662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.364304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.364574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.364841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.375711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.377216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d65638-2c20-4004-8a20-387bab9b7236 service glance] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.391066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1131/2255] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:42.465808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.466015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.466265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] PATH_INFO: `/` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.467586 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1125/2256] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:47:42.473171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11ad5-3efd-43c6-9f8a-1ff10e07ecd2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.473499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11ad5-3efd-43c6-9f8a-1ff10e07ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.473811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a11ad5-3efd-43c6-9f8a-1ff10e07ecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.494163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-89a11ad5-3efd-43c6-9f8a-1ff10e07ecd2 None None] MFA Rules not processed for user `a6987a8308864fb599f4a2a2ecfa226a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:42.495408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-89a11ad5-3efd-43c6-9f8a-1ff10e07ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.552239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1132/2257] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:42.565436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.567613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.581516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5405ea-87a5-4fa6-a6a6-6e9a7662b64b None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.585183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.585866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.586202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.586531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.594719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.596400 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a016e9-c071-4637-af8a-e8ef621a0028 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.605511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1126/2258] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:42.700710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.701038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.701313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] PATH_INFO: `/` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.702730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1133/2259] 10.222.0.93 () {54 vars in 921 bytes} [Wed Aug 24 15:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:47:42.707928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad625ec-723f-47c0-a06e-b51dac6b8a74 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.708212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad625ec-723f-47c0-a06e-b51dac6b8a74 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.708484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad625ec-723f-47c0-a06e-b51dac6b8a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.728927 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-2ad625ec-723f-47c0-a06e-b51dac6b8a74 None None] MFA Rules not processed for user `79b6528e8e264539aae69a23f7e2b4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:42.730153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2ad625ec-723f-47c0-a06e-b51dac6b8a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.740234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1127/2260] 10.222.0.93 () {58 vars in 1018 bytes} [Wed Aug 24 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:47:42.753254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:42.755157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:42.771376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855a112-0f76-496a-91e7-7f6f027ada6f None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:42.775141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:42.775796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:42.776074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:42.776347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:42.788738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:42.790241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:42.802518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1134/2261] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:45.527354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:45.528175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:45.528345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:45.551585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:45.553243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:45.563891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1128/2262] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:45.577341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:45.593856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65754cb4-dfec-4475-a1f8-5e7ced578f9d service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:45.599201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:45.599812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:45.600080 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:45.600348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:45.609801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:45.611986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e403-996d-4c60-9b1d-25263f02a9c3 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:45.626174 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1135/2263] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:47:53.780945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:53.900246 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033868b1-78d1-44e9-97c0-8faeb7839709 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:53.906258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:53.907009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:53.907283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:53.907553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] PATH_INFO: `/v3/users/8f0466f35a514370873724c729a90352` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:53.908746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0466f35a514370873724c729a90352)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:53.910882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:53.986784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0466f35a514370873724c729a90352'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:53.987883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0466f35a514370873724c729a90352'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:53.988787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0466f35a514370873724c729a90352'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.016059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0466f35a514370873724c729a90352'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.019525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:54.027750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0466f35a514370873724c729a90352'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.044717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1129/2264] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:47:53 2022] DELETE /identity/v3/users/8f0466f35a514370873724c729a90352 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:47:54.050592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.051189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.051472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.089505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:47:54.093035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:54.183488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1136/2265] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:47:54.193376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:54.195598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:54.288886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde505-c8f3-40a3-b6dc-982287eda291 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:54.292953 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:54.293971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.294367 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.294669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.305664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:54.307284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508d812-6908-4d81-8d82-57790d1be826 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:54.317636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1130/2266] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:47:54.743871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:47:54.746051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:47:54.776339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983a7c4-25e1-4ee9-b547-01f5ce4a83ab None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:47:54.789491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:47:54.790649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:47:54.791278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:47:54.792019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] PATH_INFO: `/v3/projects/15fbf21dacd44fb59ed417aa0e44a72e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:47:54.797324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fbf21dacd44fb59ed417aa0e44a72e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:47:54.802592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:47:54.868468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:54.918905 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fbf21dacd44fb59ed417aa0e44a72e', 'request_id': 'req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.938814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fbf21dacd44fb59ed417aa0e44a72e', 'request_id': 'req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.949253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fbf21dacd44fb59ed417aa0e44a72e', 'request_id': 'req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.966611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] The token cache is being invalidate because project 15fbf21dacd44fb59ed417aa0e44a72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:47:54.966914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.967589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:47:54.969308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1137/2267] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:47:54 2022] DELETE /identity/v3/projects/15fbf21dacd44fb59ed417aa0e44a72e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:48:03.834870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:03.835506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:03.835792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:03.864541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:03.866456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:03.944064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1131/2268] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:48:03.975192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:03.979581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:04.092831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8b0d-69a7-4a86-a34d-6bc92ac643dd admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:04.098611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:04.099294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:04.099610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:04.099929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:04.112225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:04.115470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc26ef-7ece-43ff-952d-f3639873a256 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:04.131761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1138/2269] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:48:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:13.933422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=1,keystone:SELECT=57 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:14.124456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=7,keystone:SELECT=47,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:24.525117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:48:24.528479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:24.679044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9dbd4-0f4b-4597-8a6e-006e00539089 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:48:24.688431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:48:24.689658 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:24.690096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:24.690417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:24.693353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:24.720274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:48:24.724865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc0104-6822-4ca3-b2af-d8dedf0a0593 service placement] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:48:24.747736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1132/2270] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:48:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:48:34.734849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=32 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:35.952649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101967-335c-4553-ba0e-6d3a47da85b7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:35.953294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101967-335c-4553-ba0e-6d3a47da85b7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:35.953487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101967-335c-4553-ba0e-6d3a47da85b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:35.977308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e5101967-335c-4553-ba0e-6d3a47da85b7 None None] MFA Rules not processed for user `88dab4e4b3904ca4a97d44597619dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:35.978638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e5101967-335c-4553-ba0e-6d3a47da85b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:36.047347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1139/2271] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:48:43.246768 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ea7d-093b-4de8-ab52-87a0d19bc978 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:43.247366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ea7d-093b-4de8-ab52-87a0d19bc978 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:43.247707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ea7d-093b-4de8-ab52-87a0d19bc978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:43.279594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1096ea7d-093b-4de8-ab52-87a0d19bc978 None None] MFA Rules not processed for user `76c00cbffad2450e8b95a7df7725fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:43.280991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1096ea7d-093b-4de8-ab52-87a0d19bc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:43.378891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1133/2272] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:48:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:48:46.037680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=25 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:53.364688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=25 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:57.599514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:48:57.600487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:48:57.600487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:48:57.633811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] MFA Rules not processed for user `48d622b254f1464aba742a350f5bf20a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:48:57.635291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:48:57.727154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1140/2273] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:07.715380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=25 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:30.339882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fab-51a4-4636-b9ea-1a74ebeda3a6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:30.340755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fab-51a4-4636-b9ea-1a74ebeda3a6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:30.340755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a757fab-51a4-4636-b9ea-1a74ebeda3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:30.374520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8a757fab-51a4-4636-b9ea-1a74ebeda3a6 None None] MFA Rules not processed for user `98e2a4c69c5b401f9a5009aeeda7fb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:30.375871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8a757fab-51a4-4636-b9ea-1a74ebeda3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:30.455661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1134/2274] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:40.446203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=25 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:57.409089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:57.417100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:57.455602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:57.456219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:57.456803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:57.483967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] MFA Rules not processed for user `88dab4e4b3904ca4a97d44597619dc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:57.485538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:57.498980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1135/2275] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:57.532321 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783348-ab01-4dda-82c1-c52bc831c6f8 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:57.537809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:57.538639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:57.538808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:57.539303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] PATH_INFO: `/v3/users/76c00cbffad2450e8b95a7df7725fc06` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:57.540556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c00cbffad2450e8b95a7df7725fc06)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:57.542787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:57.626208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c00cbffad2450e8b95a7df7725fc06'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:57.628957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c00cbffad2450e8b95a7df7725fc06'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:57.633556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c00cbffad2450e8b95a7df7725fc06'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:57.670613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c00cbffad2450e8b95a7df7725fc06'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:57.687871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f6ce3324-e5ac-4191-b6e4-c8ab9f70fab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c00cbffad2450e8b95a7df7725fc06'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:57.710603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1141/2276] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:49:57 2022] DELETE /identity/v3/users/76c00cbffad2450e8b95a7df7725fc06 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:49:58.115083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.128485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed5ee-6402-4381-9d06-b2022a8b06b6 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.230429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.231270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.231729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.232010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] PATH_INFO: `/v3/projects/0a6cf40933ed45599113f0f20ba22436` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.233255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6cf40933ed45599113f0f20ba22436)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.235760 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.295832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6cf40933ed45599113f0f20ba22436', 'request_id': 'req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:58.313661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6cf40933ed45599113f0f20ba22436', 'request_id': 'req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:58.324446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6cf40933ed45599113f0f20ba22436', 'request_id': 'req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:58.345695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] The token cache is being invalidate because project 0a6cf40933ed45599113f0f20ba22436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:49:58.346388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:58.347530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-1089ec22-f12e-4a87-9cfd-36b5f5aed1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:49:58.350718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1136/2277] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:49:58 2022] DELETE /identity/v3/projects/0a6cf40933ed45599113f0f20ba22436 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:49:58.361642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.362696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.363729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.417246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:58.418716 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:58.494482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1142/2278] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:58.508946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.509883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.510308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.537120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:58.537996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:58.551134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1137/2279] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:58.552740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.564424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61700f55-5e2c-4edd-8e82-cc3be05ffd2d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.571088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.571892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.572966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.575379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.576179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:49:58.576437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.578172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.596789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1143/2280] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:49:58.601451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.612122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ab82-3de8-499e-a2c0-6890f6585845 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.618547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.619208 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.619483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.619922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.620812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.622876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.669095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1138/2281] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:49:58 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:49:58.670428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.684970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91619-07e0-4444-8398-82bcfa8131ef admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.689990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:58.761331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.761946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.762236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.762643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.763105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.765705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.795638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1144/2282] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:49:58 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:49:58.798946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.816169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56615-69e7-43c3-8953-55342ce7e452 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.824337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.825222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.825906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.826072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.827150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.829806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.843651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1139/2283] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:49:58.848132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.869417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496d98-a19b-4c60-88f2-8bfdac83048f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.876421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.877091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.877379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.877651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.878312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.879943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d933980-09c3-479f-a267-56cd40e09185 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.894091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1145/2284] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:49:58.899145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:58.911970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4c71-8b53-42f5-b2ba-a5af9310f743 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:58.918344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:58.919050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.920026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.920026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] PATH_INFO: `/v3/projects/a13bc249c62749c1a818cb95f1d971e1/users/e3342896a3d5427face84d962656bdac/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:58.942486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13bc249c62749c1a818cb95f1d971e1, user_id=e3342896a3d5427face84d962656bdac, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:58.945234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:58.975909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1140/2285] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:49:58 2022] PUT /identity/v3/projects/a13bc249c62749c1a818cb95f1d971e1/users/e3342896a3d5427face84d962656bdac/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:49:58.993979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:58.993979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:58.994364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.045039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] MFA Rules not processed for user `e3342896a3d5427face84d962656bdac`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:59.046360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:59.146725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1146/2286] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:59.147686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.171952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:59.241697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666869-e28d-48f4-8079-eb39c399f085 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.246757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.247366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.247636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.247903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.248536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.250743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.291369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1141/2287] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:49:59 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:49:59.297888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.310287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5f77-0e78-4c61-ba05-6ecd30bc8703 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.392474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.393226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.393521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.393813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.394503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.396459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.424487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1147/2288] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:49:59 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:49:59.427547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.469318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f0ca3-a4f2-42b3-a132-a211108a2a2a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.482326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.483636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.484087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.484559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.485707 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.488362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.509022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1142/2289] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:49:59.515072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.523990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:49:59.532070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afedda7-0979-473c-b4b3-a17675fbb34f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.538714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.539644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.539861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.540072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] PATH_INFO: `/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5/users/c6316cd1abcc4f4d81c0f3e0dbf553a3/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.565697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a2485c5d5c4e55a047b00e24bea7c5, user_id=c6316cd1abcc4f4d81c0f3e0dbf553a3, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.570908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.595740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1148/2290] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:49:59 2022] PUT /identity/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5/users/c6316cd1abcc4f4d81c0f3e0dbf553a3/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:49:59.601128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.615176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f534e6-206c-431c-b3a7-2defe85b1ab5 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.709995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.710838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.711111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.711384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.712029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.713670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0c080-b252-43b8-bb50-49327848f4f6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.725192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1143/2291] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:49:59.730295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.746369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369380-966b-4b06-8c91-437880decdbd admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:49:59.751347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:49:59.752157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.752469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.752739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] PATH_INFO: `/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5/users/c6316cd1abcc4f4d81c0f3e0dbf553a3/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.754771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a2485c5d5c4e55a047b00e24bea7c5, user_id=c6316cd1abcc4f4d81c0f3e0dbf553a3, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:49:59.757582 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:49:59.772809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1149/2292] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:49:59 2022] PUT /identity/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5/users/c6316cd1abcc4f4d81c0f3e0dbf553a3/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:49:59.786068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:49:59.786554 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:49:59.786968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:49:59.835402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] MFA Rules not processed for user `c6316cd1abcc4f4d81c0f3e0dbf553a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:49:59.838533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:49:59.942016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1144/2293] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:49:59.960141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:49:59.962134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:00.041902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5387-4b4e-436d-abce-2c565737100b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:00.046907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:00.047733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:00.048197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:00.048640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:00.062085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:00.063742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa0b3-9954-439a-9e94-beae07bab999 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:00.077824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1150/2294] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:00.245245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:00.277384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:00.352700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aeb85-8cf8-4141-9267-e1a4ef252a99 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:00.361259 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:00.361706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:00.361978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:00.362341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] PATH_INFO: `/v3/users/e3342896a3d5427face84d962656bdac` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:00.363660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3342896a3d5427face84d962656bdac)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:00.367189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:00.436222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3342896a3d5427face84d962656bdac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:00.437028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3342896a3d5427face84d962656bdac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:00.438462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3342896a3d5427face84d962656bdac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:00.458165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3342896a3d5427face84d962656bdac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:00.474600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3342896a3d5427face84d962656bdac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:00.501245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1145/2295] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:50:00 2022] DELETE /identity/v3/users/e3342896a3d5427face84d962656bdac => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:00.508070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:00.508781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:00.508781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:00.537855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:00.540142 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:00.635196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1151/2296] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:00.647406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:00.649353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:00.727234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9867-3771-4b2f-b349-224dc9a47522 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:00.731812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:00.733085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:00.734039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:00.734615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:00.752925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:00.755691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:00.785321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1146/2297] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:50:01.190438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:01.192056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:01.214787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d27d0e-5dd7-4c3e-b998-f5a3e1c3dc57 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:01.227210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:01.228357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:01.228357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:01.228587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] PATH_INFO: `/v3/projects/a13bc249c62749c1a818cb95f1d971e1` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:01.229861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13bc249c62749c1a818cb95f1d971e1)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:01.233184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:01.314829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13bc249c62749c1a818cb95f1d971e1', 'request_id': 'req-f96daa60-518f-4c09-a4a5-6d590e417b48'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.324141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13bc249c62749c1a818cb95f1d971e1', 'request_id': 'req-f96daa60-518f-4c09-a4a5-6d590e417b48'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.335202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13bc249c62749c1a818cb95f1d971e1', 'request_id': 'req-f96daa60-518f-4c09-a4a5-6d590e417b48'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.340036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:01.354573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] The token cache is being invalidate because project a13bc249c62749c1a818cb95f1d971e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:50:01.355139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.356302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.358694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1152/2298] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:50:01 2022] DELETE /identity/v3/projects/a13bc249c62749c1a818cb95f1d971e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:01.362808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:01.376319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95db8f-4b2b-466b-838d-2cb478d2d018 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:01.465815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:01.509145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:01.509793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:01.510065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:01.510336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] PATH_INFO: `/v3/users/c6316cd1abcc4f4d81c0f3e0dbf553a3` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:01.511811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6316cd1abcc4f4d81c0f3e0dbf553a3)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:01.514197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:01.606796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6316cd1abcc4f4d81c0f3e0dbf553a3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.608454 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6316cd1abcc4f4d81c0f3e0dbf553a3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.609915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6316cd1abcc4f4d81c0f3e0dbf553a3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.638734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6316cd1abcc4f4d81c0f3e0dbf553a3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.660970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3236cd22-b8c0-4e99-a0d8-3f1d98184007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6316cd1abcc4f4d81c0f3e0dbf553a3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:01.668964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1147/2299] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:50:01 2022] DELETE /identity/v3/users/c6316cd1abcc4f4d81c0f3e0dbf553a3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:50:02.006482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.018668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:02.068384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96daa60-518f-4c09-a4a5-6d590e417b48 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.154062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.154719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.155007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.155275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] PATH_INFO: `/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.156434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a2485c5d5c4e55a047b00e24bea7c5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.159794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.218177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a2485c5d5c4e55a047b00e24bea7c5', 'request_id': 'req-3408c31e-389f-4401-b274-b528ec8a8ee6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:02.235369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a2485c5d5c4e55a047b00e24bea7c5', 'request_id': 'req-3408c31e-389f-4401-b274-b528ec8a8ee6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:02.243061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a2485c5d5c4e55a047b00e24bea7c5', 'request_id': 'req-3408c31e-389f-4401-b274-b528ec8a8ee6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:02.257655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] The token cache is being invalidate because project 81a2485c5d5c4e55a047b00e24bea7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:50:02.257980 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:02.258696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3408c31e-389f-4401-b274-b528ec8a8ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:02.260346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1153/2300] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:50:02 2022] DELETE /identity/v3/projects/81a2485c5d5c4e55a047b00e24bea7c5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:02.265978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.266433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.266759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.298205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:02.299354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:02.392809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1148/2301] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:02.401930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.402423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.402903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.430720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:02.433591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:02.442597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1154/2302] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:02.449195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.462538 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1ff03-cdbc-4f92-87a4-27efa163eaaf None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.470062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.471095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.471368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.471636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.472751 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:50:02.473093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.474785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.489152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1149/2303] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:50:02.493744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.504628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d24b79-ef24-4ec3-9b9f-d7cfe6f1db52 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.509856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.510607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.510930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.511287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.512024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.514201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.547948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1155/2304] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:50:02 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:02.553786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.570106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df516-3154-4ecd-a8d2-2706c88a5542 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.617134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:02.635002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.635831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.636310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.636783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.637932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.641967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.676388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1150/2305] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:50:02 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:02.678424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.698123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f63c-4e60-411f-a678-6bc069fa1f6d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.702963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.704450 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.704747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.705077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.705734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.707457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.720516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1156/2306] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:50:02.725258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.739797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb61b54-7ea6-4553-b24b-f5c724476d54 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.746966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.747592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.747865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.748238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.748937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.750836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279b967-0473-4a14-ae74-bf40525d3cb5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.763591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1151/2307] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:50:02.770075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.784706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7bd7-e501-4968-9fa1-cb389e046a6b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:02.792112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:02.792829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.793143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.793669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] PATH_INFO: `/v3/projects/91df72a1a4a14cdba03adba2c5a9db08/users/6f2b1a9139a54733bf5d8104b633803e/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.816452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df72a1a4a14cdba03adba2c5a9db08, user_id=6f2b1a9139a54733bf5d8104b633803e, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:02.819093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:02.840355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1157/2308] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:50:02 2022] PUT /identity/v3/projects/91df72a1a4a14cdba03adba2c5a9db08/users/6f2b1a9139a54733bf5d8104b633803e/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:02.851956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:02.853209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:02.853504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:02.895824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] MFA Rules not processed for user `6f2b1a9139a54733bf5d8104b633803e`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:02.897462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:02.979721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1152/2309] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:02.992046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:02.993873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:03.019128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:03.061634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b418a6-0e8c-466b-be39-9874a0c84c57 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:03.065950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:03.066693 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:03.066893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:03.067164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:03.076870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:03.078351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec8956-fe4d-4e64-aecd-58d42a06a5b2 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:03.088385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1158/2310] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:03.113713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:03.205373 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17e7d-21a9-47da-9690-793af9b4eaad None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:03.211292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:03.211957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:03.212294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:03.212506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] PATH_INFO: `/v3/users/6f2b1a9139a54733bf5d8104b633803e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:03.213873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2b1a9139a54733bf5d8104b633803e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:03.215951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:03.287109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2b1a9139a54733bf5d8104b633803e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:03.287866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2b1a9139a54733bf5d8104b633803e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:03.288588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2b1a9139a54733bf5d8104b633803e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:03.295826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:03.306370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2b1a9139a54733bf5d8104b633803e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:03.318115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2b1a9139a54733bf5d8104b633803e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:03.335267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1153/2311] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:50:03 2022] DELETE /identity/v3/users/6f2b1a9139a54733bf5d8104b633803e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:03.340742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:03.341177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:03.341465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:03.362123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:03.363320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:03.448721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1159/2312] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:03.464354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:03.466048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:03.525999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002b89-83f9-41ce-ae6a-c71953c20962 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:03.529787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:03.530407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:03.531007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:03.531007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:03.541921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:03.543363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fc956-331f-47c1-96fb-96308a39d550 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:03.553344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1154/2313] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:03.890350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:03.891970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:03.909527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff0b-e1f3-44b5-816e-9c1c0611dda6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:03.918130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:03.920047 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:03.920434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:03.920942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] PATH_INFO: `/v3/projects/91df72a1a4a14cdba03adba2c5a9db08` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:03.929437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df72a1a4a14cdba03adba2c5a9db08)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:03.931430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:03.994149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df72a1a4a14cdba03adba2c5a9db08', 'request_id': 'req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:04.002510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df72a1a4a14cdba03adba2c5a9db08', 'request_id': 'req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:04.011127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df72a1a4a14cdba03adba2c5a9db08', 'request_id': 'req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:04.028287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] The token cache is being invalidate because project 91df72a1a4a14cdba03adba2c5a9db08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:50:04.029346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:04.030149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-188d9d77-1dbc-4a17-9f63-3ec040c0a59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:04.032586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1160/2314] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:50:03 2022] DELETE /identity/v3/projects/91df72a1a4a14cdba03adba2c5a9db08 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:04.039352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.039950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.040343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.071144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:04.072387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:04.178804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1155/2315] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:04.188414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.188763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.189140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.215771 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:04.218156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:04.229092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1161/2316] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:04.235131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.245566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa309c8a-8d3b-4849-b9b2-c82c676339cf None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.251034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.251801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.252167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.252535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.253479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:50:04.253842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.255893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.270166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1156/2317] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:50:04.276340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.287230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb389c8-74e6-4fe4-abb6-d06803593a77 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.292440 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.293207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.293475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.293740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.294378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.296528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.334837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1162/2318] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:50:04 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:04.339308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.355960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ac1-c7dc-41f6-9484-4ed5f76f5786 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.436169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.437241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.437770 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.438221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.439136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.441265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.451395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:04.476523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1157/2319] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:50:04 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:04.482323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.495319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598d6a-7ee7-4445-8838-93ee7cf3d308 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.503107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.504256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.504663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.505173 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.506360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.509475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.534630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1163/2320] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:50:04.535944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.551504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9129fd-1a84-49b5-b024-ad7b86ef1613 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.560414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.561913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.561913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.561913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.562333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.564198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9b691-5445-4285-ac76-be8a9f29b997 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.592295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1158/2321] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:50:04.596820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.609140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deda32-85fb-4f20-9ee8-e1428cb7d237 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.616063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.616402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.616732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.616871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] PATH_INFO: `/v3/projects/043878e8d488426c9f2cd8490853fec6/users/b3a49b4d606447eba4f73bd67d65bbba/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.619758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:04.646023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043878e8d488426c9f2cd8490853fec6, user_id=b3a49b4d606447eba4f73bd67d65bbba, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.651396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.671507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1164/2322] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:50:04 2022] PUT /identity/v3/projects/043878e8d488426c9f2cd8490853fec6/users/b3a49b4d606447eba4f73bd67d65bbba/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:50:04.681975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.682264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.682516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.711892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] MFA Rules not processed for user `b3a49b4d606447eba4f73bd67d65bbba`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:04.713168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:04.795125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1159/2323] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:50:04.809491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:04.811264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:04.889028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc2c6b-9c11-4cff-8abb-71c1c2d6e5b8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:04.895025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:04.896116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:04.896612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:04.897175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:04.910668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:04.912162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:04.922487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1165/2324] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:05.693967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:05.696442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:05.771207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33fa00-7bd7-4201-8f3c-d3f64a75c63d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:05.775253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:05.775937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:05.776310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:05.776683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:05.779175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:05.860810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:05.862390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3b45a-dc3c-4169-920d-3d56f50d13b0 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:05.874976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1160/2325] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:08.289778 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:08.291779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:08.309189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96744dc-bd9b-43dd-8ed1-2f60a63bd9d5 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:08.315668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:08.316509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:08.317033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:08.317513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:08.321677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:08.339965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:08.343358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:08.356638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1166/2326] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:50:15.869120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=2,keystone:SELECT=93 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:16.631151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:16.631572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:16.631865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:16.655431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:16.657911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:16.727268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1161/2327] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:50:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:16.777520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:16.779486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:16.860601 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a18e9-d268-4747-bbfa-41b9c9caee4e service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:16.865765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:16.866584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:16.866860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:16.867125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:16.876680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:16.878326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b146a-b6a3-4904-89a1-49d0ee287162 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:16.892587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1167/2328] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:17.412130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:17.528413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b38c-78b0-4b8b-b969-8d9630bfb8ab None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:17.535667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:17.536334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:17.536617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:17.536894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] PATH_INFO: `/v3/users/b3a49b4d606447eba4f73bd67d65bbba` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:17.538133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a49b4d606447eba4f73bd67d65bbba)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:17.540948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:17.617849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a49b4d606447eba4f73bd67d65bbba'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:17.618868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a49b4d606447eba4f73bd67d65bbba'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:17.619764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a49b4d606447eba4f73bd67d65bbba'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:17.642227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a49b4d606447eba4f73bd67d65bbba'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:17.655251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a49b4d606447eba4f73bd67d65bbba'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:17.683046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1162/2329] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:50:17 2022] DELETE /identity/v3/users/b3a49b4d606447eba4f73bd67d65bbba => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:17.688544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:17.688890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:17.689323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:17.726406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:17.728002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:17.869332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1168/2330] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:17.882951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:17.885155 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:17.937747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:18.000537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29f2f-8f8f-4ad8-bbe7-9dc797b21508 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:18.006189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:18.007485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:18.008525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:18.009218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:18.028177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:18.030381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688c47e-8800-4964-acc0-56f8b3d99702 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:18.047740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1163/2331] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:18.537070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:18.538613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:18.548285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:18.567633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991fd90-84db-4cb0-8f12-f7d542f1dd53 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:18.574414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:18.575019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:18.575308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:18.575609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] PATH_INFO: `/v3/projects/043878e8d488426c9f2cd8490853fec6` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:18.576860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043878e8d488426c9f2cd8490853fec6)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:18.578991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:18.665224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043878e8d488426c9f2cd8490853fec6', 'request_id': 'req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:18.688966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043878e8d488426c9f2cd8490853fec6', 'request_id': 'req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:18.704770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043878e8d488426c9f2cd8490853fec6', 'request_id': 'req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:18.738288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] The token cache is being invalidate because project 043878e8d488426c9f2cd8490853fec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:50:18.740360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:18.741919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d63fc6a4-58df-4f77-89d9-fb25ce69cea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:18.744581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1169/2332] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:50:18 2022] DELETE /identity/v3/projects/043878e8d488426c9f2cd8490853fec6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:18.750976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:18.751548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:18.751946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:18.779360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:18.781797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:18.909636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1164/2333] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:18.921974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:18.923162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:18.923759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:18.964085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:18.964835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:18.982646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1170/2334] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:50:18.989580 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.011495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aee7e-0be2-4478-93ca-3fa9af197750 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.024045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.025221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.025681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.032352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.033935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:50:19.034460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.048534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.075197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1165/2335] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:50:19.081858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.096755 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3a3f3-faec-4874-b711-f41a5fc7cf5a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.112643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.115127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.115433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.115890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.116957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.119812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.179051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1171/2336] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:50:19 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:19.185111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.211027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832956b-27ce-496c-85e8-c22d520c61e1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.377633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.378236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.378520 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.378784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.379434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.382757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.428324 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1166/2337] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:50:19 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:19.430931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.455656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a154a5b-2a07-40d3-99ce-f868218c3865 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.462886 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.463902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.464300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.464663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.465654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.468498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.491071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1172/2338] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:50:19.497924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.519052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e302b-04d7-42de-8262-6ccfcf8dc1d5 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.527166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.528099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.528518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.528801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.529767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.532184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b77e-0aba-42ff-b5e0-189166df4987 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.553618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1167/2339] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:50:19.559437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.579186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc117d-1645-444e-8c41-b6a1d32903e6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:19.585913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:19.586907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.587350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.587623 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] PATH_INFO: `/v3/projects/1065d9f7ebcd404892e11b82766128e2/users/bc19540e4776494aa8c685aec04cbb1d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.613060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065d9f7ebcd404892e11b82766128e2, user_id=bc19540e4776494aa8c685aec04cbb1d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:19.618578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:19.657466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1173/2340] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:50:19 2022] PUT /identity/v3/projects/1065d9f7ebcd404892e11b82766128e2/users/bc19540e4776494aa8c685aec04cbb1d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:50:19.673074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:19.674061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:19.681410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:19.753176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] MFA Rules not processed for user `bc19540e4776494aa8c685aec04cbb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:19.755316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:19.812348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:19.898128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1168/2341] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:50:19.921120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:19.922866 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:20.032165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c4c4-b57f-4cd6-891b-fcfac28003d5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:20.039579 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:20.040074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:20.040565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:20.041113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:20.056199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:20.059224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:20.076182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1174/2342] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:50:23.619981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:23.621862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:23.744689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135498-7a42-4725-bb6f-039121cbed5c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:23.751381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:23.752223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:23.752513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:23.752786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:23.755210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:23.869857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:23.873145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4b6da-f684-4dc5-9ffd-2e30ebae0d95 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:23.896736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1169/2343] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:23.920689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:23.985402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:24.088177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5f2f5-a9b7-4c54-842c-54bbec38aa87 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:24.096053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:24.097025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:24.097489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:24.098100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] PATH_INFO: `/v3/users/bc19540e4776494aa8c685aec04cbb1d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:24.099958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc19540e4776494aa8c685aec04cbb1d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:24.102992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:24.232344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc19540e4776494aa8c685aec04cbb1d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:24.233403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc19540e4776494aa8c685aec04cbb1d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:24.234516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc19540e4776494aa8c685aec04cbb1d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:24.273567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc19540e4776494aa8c685aec04cbb1d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:24.301376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc19540e4776494aa8c685aec04cbb1d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:24.340587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1175/2344] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:50:23 2022] DELETE /identity/v3/users/bc19540e4776494aa8c685aec04cbb1d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:24.348140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:24.348930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:24.349176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:24.395268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:24.397433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:24.519327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:24.555546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1170/2345] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:50:24.572098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:24.574212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:24.712072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820714b-358f-4ad2-932c-fa3bca0a9332 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:24.718641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:24.720227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:24.720698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:24.721220 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:24.737424 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:24.740170 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306eb5-49d2-40c2-a925-0378e49f1ab3 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:24.759162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1176/2346] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:25.246688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:25.249501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:25.272832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f546a-efb6-401f-9fa6-6fc67ce55f01 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:25.283239 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:25.285213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:25.286161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:25.287470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] PATH_INFO: `/v3/projects/1065d9f7ebcd404892e11b82766128e2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:25.291229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1065d9f7ebcd404892e11b82766128e2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:25.295209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:25.404827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1065d9f7ebcd404892e11b82766128e2', 'request_id': 'req-a8971933-dff6-4185-a16a-f6f0b9eec57e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:25.429896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1065d9f7ebcd404892e11b82766128e2', 'request_id': 'req-a8971933-dff6-4185-a16a-f6f0b9eec57e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:25.444021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1065d9f7ebcd404892e11b82766128e2', 'request_id': 'req-a8971933-dff6-4185-a16a-f6f0b9eec57e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:25.469537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] The token cache is being invalidate because project 1065d9f7ebcd404892e11b82766128e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:50:25.470035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:25.471116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a8971933-dff6-4185-a16a-f6f0b9eec57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:50:25.473746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1171/2347] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:50:25 2022] DELETE /identity/v3/projects/1065d9f7ebcd404892e11b82766128e2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:50:25.481539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:25.483111 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:25.484076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:25.521751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:25.523818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:25.629666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:25.692974 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1177/2348] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:25.697072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:25.697749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:25.700004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:25.740643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:25.743495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:25.761995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1172/2349] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:25.768542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:25.783797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da856983-46d6-468a-b655-7d2c76512fb0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:25.791695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:25.792684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:25.793107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:25.793548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:25.794334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:50:25.794738 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:25.797143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:25.825446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1178/2350] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:50:25.831903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:25.845570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3566e5-3858-460b-adcb-819219a28553 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:25.858285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:25.859746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:25.860326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:25.860888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:25.862146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:25.865968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:25.939012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1173/2351] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:50:25 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:25.947010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:25.966721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e63f7-0ebe-457f-845e-51bc2c702222 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:26.137263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:26.137906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.138300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.138781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.140662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:26.143964 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:26.207986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1179/2352] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:50:25 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:50:26.210912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:26.237601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbd3fa-4ef6-4fdf-9d48-77340bb4c171 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:26.259466 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:26.262573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.263754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.265210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.267406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:26.270686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:26.297892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1174/2353] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:50:26.300163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:26.320113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77d8c-9335-431b-aafa-d8aa1bf15207 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:26.337872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:26.338539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.338870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.339153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.339913 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:26.342187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9321fb-d668-4304-b03c-42bfc75185cd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:26.364147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1180/2354] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:50:26.371039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:26.393290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7f7df-efea-423d-87b6-210163e38231 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:26.400405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:26.401391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.401965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.402158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] PATH_INFO: `/v3/projects/f72568c99367434f8a68f5801bfce72f/users/6501f1cadbaf4e1781586b002a64d8fd/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.430191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72568c99367434f8a68f5801bfce72f, user_id=6501f1cadbaf4e1781586b002a64d8fd, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:26.434423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:26.462583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1175/2355] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:50:26 2022] PUT /identity/v3/projects/f72568c99367434f8a68f5801bfce72f/users/6501f1cadbaf4e1781586b002a64d8fd/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:50:26.470019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c07-104d-4882-8f40-a737f4bd86aa None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.470589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c07-104d-4882-8f40-a737f4bd86aa None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.471436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c07-104d-4882-8f40-a737f4bd86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.506514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-580d2c07-104d-4882-8f40-a737f4bd86aa None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:26.508941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-580d2c07-104d-4882-8f40-a737f4bd86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:26.645362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1181/2356] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:26.660417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:26.662716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:26.790629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74178-b346-4dce-be68-e6a642ef7a41 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:26.797831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:26.799049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:26.799517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:26.799947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:26.816563 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:26.819060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:26.839649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1176/2357] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:28.072085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:28.072815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:28.073126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:28.115645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] MFA Rules not processed for user `6501f1cadbaf4e1781586b002a64d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:28.117370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:28.181920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:28.259035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1182/2358] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:28.283950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:28.288543 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:28.340704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:28.425719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec28f-ffe7-41eb-8389-e9338359689b service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:28.433795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:28.435758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:28.435758 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:28.436199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:28.456170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:28.458374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12395dc9-978b-4290-9e4c-2d58b7574dff service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:28.478037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1177/2359] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:29.756638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:29.758649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:29.780225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65f7b-36db-416e-b8d9-f6618dab53c6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:29.784010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:29.784634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:29.784951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:29.785211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:29.787032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:29.803025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:29.805684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:29.815789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1183/2360] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:30.304797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:30.305800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:30.305800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:30.328068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] MFA Rules not processed for user `6501f1cadbaf4e1781586b002a64d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:30.329363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:30.340059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1178/2361] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:50:31.098780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:31.100444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:31.172229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:31.174072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:31.199821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa6e5-7dac-4fec-9d4b-bdaf118bff68 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:31.208506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:31.209483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:31.209893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:31.210266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:31.212921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:31.232484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:31.234976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:31.252459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1184/2362] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:31.280502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d577f2-1129-4249-917b-441c97bd0ffb None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:31.295224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:31.295973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:31.296411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:31.296724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:31.299917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:31.399009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:31.401314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c09a0f-cdfa-48ad-909d-7806591604ba service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:31.416572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1179/2363] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:50:34.072055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:34.084330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad78e2d-887a-401b-bf72-57bd133701d7 service placement] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:34.089416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:34.090041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:34.090310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:34.090572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:34.093148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:34.108651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:34.110961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:34.123431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1185/2364] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:38.668981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:38.669701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:38.669701 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:38.693135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:38.694438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:38.785137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:38.802087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1180/2365] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:50:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:38.826395 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:38.828145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:38.958401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bc9be-96ed-44a9-985a-fed7677438f1 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:38.964952 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:38.965682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:38.966019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:38.966347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:38.980864 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:38.984335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:38.997318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1186/2366] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:48.781737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:48.802101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfcf1d0-197d-4bff-a50f-185de6240c93 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:48.808930 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:48.809544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:48.809833 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:48.810103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:48.812179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:48.879987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:48.881662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:48.892315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1181/2367] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:48.993394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:52.328519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:52.343498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06095698-e337-413a-bd75-c561fc67e4e3 service swift] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:52.352098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:52.353036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:52.353358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:52.354449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:52.356872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:52.386117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:52.388804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d2c4-b9f6-4014-b2a9-d1c40ec64d61 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:52.406516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1187/2368] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:50:54.468163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:54.469794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:54.484984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe1ab9-b41a-4574-b557-ce0bc5bd261a service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:54.491816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:54.492546 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:54.492878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:54.493330 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:54.495479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:54.509882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:54.511925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:54.525205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1182/2369] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:50:56.868826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc819a-4b25-4ef3-a538-ce1177d900d2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:56.870211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc819a-4b25-4ef3-a538-ce1177d900d2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:56.871210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc819a-4b25-4ef3-a538-ce1177d900d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:56.902674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e6dc819a-4b25-4ef3-a538-ce1177d900d2 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:56.905269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e6dc819a-4b25-4ef3-a538-ce1177d900d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:56.917603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1188/2370] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:56.935486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:56.948311 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3175c3-42ad-44d6-8421-ce3ccb0392f7 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:56.954409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:56.955216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:56.955621 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:56.956057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:56.966667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:50:56.968352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:50:56.978018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1183/2371] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:50:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:59.837609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:59.838223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:59.838560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:59.883270 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] MFA Rules not processed for user `6501f1cadbaf4e1781586b002a64d8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:50:59.885867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:50:59.905020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1189/2372] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:50:59.946342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:50:59.973773 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1a124-503c-4d8b-9548-5ef6769784a1 service swift] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:50:59.980854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:50:59.989146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:50:59.989816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:50:59.990716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:50:59.996341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:00.025805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:00.028714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:00.090439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1184/2373] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:00.420376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:00.431684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b795-9aa5-4c8c-810b-15b3ecca623c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:00.436147 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:00.436979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:00.437263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:00.437533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:00.439724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:00.457225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:00.460568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:00.489018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1190/2374] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:06.524524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:06.527033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:06.567180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2fa2b-64b7-4799-9b70-958ebe417b70 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:06.575433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:06.576432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:06.577094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:06.578226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] PATH_INFO: `/v3/users/98e2a4c69c5b401f9a5009aeeda7fb4b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:06.579610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e2a4c69c5b401f9a5009aeeda7fb4b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:06.583544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:06.693266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e2a4c69c5b401f9a5009aeeda7fb4b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:06.695096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e2a4c69c5b401f9a5009aeeda7fb4b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:06.695890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e2a4c69c5b401f9a5009aeeda7fb4b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:06.718001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e2a4c69c5b401f9a5009aeeda7fb4b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:06.736213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-fa0c5ef6-fa0e-4a78-a1d6-fdeae28cd84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e2a4c69c5b401f9a5009aeeda7fb4b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:06.772823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1185/2375] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:06 2022] DELETE /identity/v3/users/98e2a4c69c5b401f9a5009aeeda7fb4b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:07.038389 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.071547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec52fc-4474-4316-905c-70b3c03c5412 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.185529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.186612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.187078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.187544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] PATH_INFO: `/v3/projects/eea15e9e3bd4415ca3e055e66b9aed16` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.190662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea15e9e3bd4415ca3e055e66b9aed16)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.194589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.262900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea15e9e3bd4415ca3e055e66b9aed16', 'request_id': 'req-c3c4afb8-cd88-4881-9c59-78155026bae1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:07.272617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea15e9e3bd4415ca3e055e66b9aed16', 'request_id': 'req-c3c4afb8-cd88-4881-9c59-78155026bae1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:07.283257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea15e9e3bd4415ca3e055e66b9aed16', 'request_id': 'req-c3c4afb8-cd88-4881-9c59-78155026bae1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:07.301177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] The token cache is being invalidate because project eea15e9e3bd4415ca3e055e66b9aed16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:07.301727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:07.302645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c3c4afb8-cd88-4881-9c59-78155026bae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:07.304889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1191/2376] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:07 2022] DELETE /identity/v3/projects/eea15e9e3bd4415ca3e055e66b9aed16 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:07.316371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.316872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.317401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.342889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:07.344216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:07.376132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:07.435476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1186/2377] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:07.445192 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.445598 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.446055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.472244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:07.473507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:07.481836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1192/2378] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:07.486575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.497357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905dc63-b3f9-4f5b-a818-19b46928456c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.502632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.503444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.503817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.504192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.504999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:07.505393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.507145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.526824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1187/2379] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:51:07.532241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.542434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c5f4-f6da-46b3-9068-62de6e58a327 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.548400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.549261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.549639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.549987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.550620 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.552652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.597303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1193/2380] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:07 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:07.603180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.614108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62641-034a-458b-bc99-61744f9dfe7e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.690793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.691452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.691729 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.692001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.693798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.693798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.729590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1188/2381] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:07 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:07.731443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.748484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0c3f-ce16-4734-ab6f-682fb01f8c1a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.756822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.758906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.759362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.759798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.760814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.763275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.785922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1194/2382] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:07.788446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.804676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779556a2-2efb-4593-b51a-d20e1cade500 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.813535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.814910 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.815666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.816132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.817304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.820342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.838583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.840782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:07.852866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1189/2383] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:07.854450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:07.859515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:07.866008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad59e4c-3fb4-436f-88e2-0d42c8ebbc3b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.871862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:07.872641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.872955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.873257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] PATH_INFO: `/v3/projects/a71d4287c9144846a340a50840911623/users/003ece45d2a643fb9b54af3a4c541b8d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.897030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71d4287c9144846a340a50840911623, user_id=003ece45d2a643fb9b54af3a4c541b8d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:07.899780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7624d36-cf59-4781-aefe-4ade6fd920b9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:07.923898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1190/2384] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:07 2022] PUT /identity/v3/projects/a71d4287c9144846a340a50840911623/users/003ece45d2a643fb9b54af3a4c541b8d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:07.935887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:07.938026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:07.938026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:07.938258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e82b17-1ea9-49ef-81e9-9230973ccde8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:07.982804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] MFA Rules not processed for user `003ece45d2a643fb9b54af3a4c541b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:07.984249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:08.006509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.007347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.007719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.008169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.011077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:08.074798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1191/2385] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:08.081451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.087982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:08.107397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.109245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.122642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1195/2386] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:08.192230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64d3c4-4046-4042-aa96-1b10f78d0c36 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.199082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.199712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.200061 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.200337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.201092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.203128 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.243025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1192/2387] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:08 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:08.247309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.260451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5098c-9bb9-4efb-8d88-10a66698bdb2 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.362786 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.363824 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.364837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.365195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.366504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.370020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.417267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1196/2388] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:08 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:08.422123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.452446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dedf4e-b2bd-4a26-b24a-9f20b669d46c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.459488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.460640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.461295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.461874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.462782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.464985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.480566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1193/2389] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:08.485102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.504565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001b83b-5958-4636-8697-05d4e9fc28ef admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.516262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.517808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.519370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.520064 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] PATH_INFO: `/v3/projects/164fb169a27044d496eeaa677052017a/users/64bbe3dfddeb404ea63c5589dbeb8cb6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.525258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:08.569444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=164fb169a27044d496eeaa677052017a, user_id=64bbe3dfddeb404ea63c5589dbeb8cb6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.574241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.605028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1197/2390] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:08 2022] PUT /identity/v3/projects/164fb169a27044d496eeaa677052017a/users/64bbe3dfddeb404ea63c5589dbeb8cb6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:08.608432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.621974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a3ae8-15f1-48c2-9474-c6682fdfd5da admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.770190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.770819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.771094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.771363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.772044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.773704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb59187-db75-433e-91b5-9aad4eb892f2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.785204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1194/2391] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:08.790459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:08.807934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fe19-ccfe-451a-9f3a-193c48ee60fd admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:08.817411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:08.818663 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.819145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.819625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] PATH_INFO: `/v3/projects/164fb169a27044d496eeaa677052017a/users/64bbe3dfddeb404ea63c5589dbeb8cb6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.823127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=164fb169a27044d496eeaa677052017a, user_id=64bbe3dfddeb404ea63c5589dbeb8cb6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:08.828086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:08.840289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1198/2392] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:08 2022] PUT /identity/v3/projects/164fb169a27044d496eeaa677052017a/users/64bbe3dfddeb404ea63c5589dbeb8cb6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:08.854828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:08.855345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:08.855799 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:08.905756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] MFA Rules not processed for user `64bbe3dfddeb404ea63c5589dbeb8cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:08.907434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:09.044127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:09.052139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1195/2393] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:09.064709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:09.067572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:09.157054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e16029-ffe7-4e48-a39c-60867dea7a1f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:09.163794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:09.164843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:09.165365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:09.166062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:09.181131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:09.182617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:09.201484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1199/2394] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:09.318573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:09.329139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c3fe-951c-49ad-b7e0-ed0f2357de61 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:09.333591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:09.334304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:09.334793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:09.335143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:09.433807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:09.436396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:09.450562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1196/2395] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:13.264202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:13.267078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:13.363517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850ee97-e8f5-4e31-a8c8-fbb8117bc2f9 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:13.369371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:13.370148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:13.370540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:13.370920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] PATH_INFO: `/v3/users/88dab4e4b3904ca4a97d44597619dc2d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:13.372329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88dab4e4b3904ca4a97d44597619dc2d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:13.374573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:13.431049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88dab4e4b3904ca4a97d44597619dc2d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.432125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88dab4e4b3904ca4a97d44597619dc2d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.433014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88dab4e4b3904ca4a97d44597619dc2d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.456094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88dab4e4b3904ca4a97d44597619dc2d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.463426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-94812981-3ddf-43ce-978c-285530caa3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88dab4e4b3904ca4a97d44597619dc2d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.465319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:13.482446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1200/2396] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:13 2022] DELETE /identity/v3/users/88dab4e4b3904ca4a97d44597619dc2d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:13.708570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:13.723629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61945f1a-7a8e-4aaf-bd44-6756b23c5b18 service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:13.828175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:13.828175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:13.828175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:13.828175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] PATH_INFO: `/v3/projects/17138034ef6f4a78bfa7d5b3a56af881` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:13.828985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17138034ef6f4a78bfa7d5b3a56af881)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:13.828985 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:13.919404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17138034ef6f4a78bfa7d5b3a56af881', 'request_id': 'req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.934882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17138034ef6f4a78bfa7d5b3a56af881', 'request_id': 'req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.945875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17138034ef6f4a78bfa7d5b3a56af881', 'request_id': 'req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.962578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] The token cache is being invalidate because project 17138034ef6f4a78bfa7d5b3a56af881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:13.963103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.963968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-662eb44b-0caa-4b45-a9d4-4a4a5963a01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:13.968932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1197/2397] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:13 2022] DELETE /identity/v3/projects/17138034ef6f4a78bfa7d5b3a56af881 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:13.973008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:13.973399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:13.973775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.001472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:14.002931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:14.108521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1201/2398] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:14.123884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.124706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.125484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.177459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:14.179990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:14.197583 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1198/2399] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:14.199558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.229422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8b6e-c361-43c2-aa2c-4cb9a95c1789 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.242586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.243803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.244302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.244821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.246241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:14.246809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.250144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.275757 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1202/2400] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:51:14.276641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.290788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e9753-b4a6-41fb-86b6-e233a6fc2f12 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.308104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.309190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.309577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.310703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.312577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.316339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.358398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:14.383785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1199/2401] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:14 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:14.385358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.397540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff92ef0-fd69-4b40-8cef-ea4d4c5177d5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.517564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.518276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.518565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.518954 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.520139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.522488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.561658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1203/2402] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:14 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:14.573506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.589068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ea00b-0ff5-4cf8-bf6c-90350cc5146f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.598700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.600638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.601213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.601823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.602978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.606649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.627860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.628718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1200/2403] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:14.645692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a71319-c149-4f4f-bbdc-44e46a7ae2ea admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.653287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.654159 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.654658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.655325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.656773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.659739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217c08-4a87-4cf0-9a78-92d1859ebbba admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.687677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1204/2404] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:14.693808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:14.706727 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27659d29-8b10-4167-afa1-acb15ebf97f4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:14.714634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:14.715675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.715895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.716713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] PATH_INFO: `/v3/projects/ffd3d72e708d46cba37718f5f54ac099/users/e16643e375a04492a24e932317b58d66/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.751043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd3d72e708d46cba37718f5f54ac099, user_id=e16643e375a04492a24e932317b58d66, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:14.756165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:14.781312 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1201/2405] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:14 2022] PUT /identity/v3/projects/ffd3d72e708d46cba37718f5f54ac099/users/e16643e375a04492a24e932317b58d66/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:14.797476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:14.797881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:14.798284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:14.839576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] MFA Rules not processed for user `e16643e375a04492a24e932317b58d66`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:14.841464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:14.892294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:14.933474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1205/2406] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:14.941189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.051488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe7dd-d15f-4e6f-8afe-7e8b64eb8a44 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.056700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.057394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.057679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.057945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.058622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.060602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.116042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1202/2407] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:14 2022] POST /identity/v3/projects => generated 363 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:15.117451 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.132580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a126d4c-e019-4db1-ae4e-b33709b127ed None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.222387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.223488 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.223973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.224461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.225720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.229695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.266477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1206/2408] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:15 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:15.271008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.283412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01019-a846-48c9-9b09-615b3b3e776f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.289281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.290192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.290661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.291027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.291645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.293347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.306766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1203/2409] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:15.312306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.324635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e4d09-3e6f-4927-a04c-f875f7bbb52f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.329705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.330408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.330688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.330961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] PATH_INFO: `/v3/projects/80644b3bf8c94f128117d27953dbcd55/users/0fe680f0601c4fbf88b6eac748c9c8ac/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.349353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80644b3bf8c94f128117d27953dbcd55, user_id=0fe680f0601c4fbf88b6eac748c9c8ac, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.352058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.367118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1207/2410] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:15 2022] PUT /identity/v3/projects/80644b3bf8c94f128117d27953dbcd55/users/0fe680f0601c4fbf88b6eac748c9c8ac/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:15.371421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.381838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e18bc-d752-4633-bc82-9a35878c08a4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.460936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.461862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.462236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.462608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.463361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.465184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae249de-8ea4-4473-a690-ed8e5e0e6361 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.480011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1204/2411] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:15.484795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.508694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dac71-0cca-4723-894e-8d6071105974 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.514105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.515593 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.516069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.516447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] PATH_INFO: `/v3/projects/80644b3bf8c94f128117d27953dbcd55/users/0fe680f0601c4fbf88b6eac748c9c8ac/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.518941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80644b3bf8c94f128117d27953dbcd55, user_id=0fe680f0601c4fbf88b6eac748c9c8ac, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.521941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.539028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1208/2412] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:15 2022] PUT /identity/v3/projects/80644b3bf8c94f128117d27953dbcd55/users/0fe680f0601c4fbf88b6eac748c9c8ac/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:15.550123 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.550405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.550722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.583062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] MFA Rules not processed for user `0fe680f0601c4fbf88b6eac748c9c8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:15.584348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:15.607170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:15.673835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1205/2413] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:15.690468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.693227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:15.772374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be31-0b31-4234-9ab8-894a4fc49b50 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.776744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.777453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.777741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.778044 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.789229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.791206 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:15.808029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1209/2414] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:15.902289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:15.914868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42cf45-8e0c-4dc0-b1ab-7688819370a4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:15.919162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:15.920012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:15.920384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:15.920745 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:15.997982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:15.999814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a444b-ed9f-4f32-b0f8-4c4b2891b307 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:16.015120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1206/2415] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:17.404211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:17.406083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:17.471261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:17.499885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603bac3-0e16-4535-9a59-3a7639df137f service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:17.507482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:17.508584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:17.509094 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:17.509616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] PATH_INFO: `/v3/users/003ece45d2a643fb9b54af3a4c541b8d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:17.511705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003ece45d2a643fb9b54af3a4c541b8d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:17.515735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:17.600965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003ece45d2a643fb9b54af3a4c541b8d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:17.602334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003ece45d2a643fb9b54af3a4c541b8d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:17.603671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003ece45d2a643fb9b54af3a4c541b8d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:17.625376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003ece45d2a643fb9b54af3a4c541b8d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:17.635356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003ece45d2a643fb9b54af3a4c541b8d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:17.659719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1210/2416] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:17 2022] DELETE /identity/v3/users/003ece45d2a643fb9b54af3a4c541b8d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:17.666161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4b95-71c6-41c9-81f7-117486005bde None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:17.666972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4b95-71c6-41c9-81f7-117486005bde None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:17.666972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4b95-71c6-41c9-81f7-117486005bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:17.715441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-707c4b95-71c6-41c9-81f7-117486005bde None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:17.717308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-707c4b95-71c6-41c9-81f7-117486005bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:17.795678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1207/2417] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:17.806551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:17.808048 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:17.884059 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3efe9d-3a58-40a1-9ee9-5015c791aeb8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:17.891565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:17.892613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:17.893153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:17.893626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:17.908428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:17.910209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:17.922544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1211/2418] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:17.978536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:17.979187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:17.979574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:18.007111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:18.008645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:18.102977 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1208/2419] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:18.130132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:18.131725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:18.231195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d3757-23fb-419e-8838-494a9a3460c2 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:18.237326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:18.237963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:18.238233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:18.238498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:18.243901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:18.249922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:18.252412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:18.266753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1212/2420] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:51:18.358744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:18.362911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:18.380268 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:18.395924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae7e1-b6e9-43e6-944b-f3f6657d5b90 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:18.403873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:18.404871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:18.404871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:18.405402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] PATH_INFO: `/v3/projects/a71d4287c9144846a340a50840911623` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:18.408505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71d4287c9144846a340a50840911623)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:18.412698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:18.508856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71d4287c9144846a340a50840911623', 'request_id': 'req-a89b2f29-881c-474d-8833-bb0578567622'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.521058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71d4287c9144846a340a50840911623', 'request_id': 'req-a89b2f29-881c-474d-8833-bb0578567622'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.531381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71d4287c9144846a340a50840911623', 'request_id': 'req-a89b2f29-881c-474d-8833-bb0578567622'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.549441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] The token cache is being invalidate because project a71d4287c9144846a340a50840911623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:18.549992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.551287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.557036 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1209/2421] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:18 2022] DELETE /identity/v3/projects/a71d4287c9144846a340a50840911623 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:18.560418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:18.578388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69286ca-096f-40d1-bf17-b15436d28c02 service swift] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:18.681207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:18.681938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:18.682210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:18.682486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] PATH_INFO: `/v3/users/64bbe3dfddeb404ea63c5589dbeb8cb6` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:18.683957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bbe3dfddeb404ea63c5589dbeb8cb6)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:18.687556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:18.780622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bbe3dfddeb404ea63c5589dbeb8cb6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.781319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bbe3dfddeb404ea63c5589dbeb8cb6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.782056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bbe3dfddeb404ea63c5589dbeb8cb6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.799449 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bbe3dfddeb404ea63c5589dbeb8cb6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.813932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4a6199bc-c833-4607-9365-fd0243c77303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bbe3dfddeb404ea63c5589dbeb8cb6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:18.859532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1213/2422] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:18 2022] DELETE /identity/v3/users/64bbe3dfddeb404ea63c5589dbeb8cb6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:19.429152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:19.431573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:19.462065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b2f29-881c-474d-8833-bb0578567622 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:19.627706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:19.629012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:19.629413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:19.629983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] PATH_INFO: `/v3/projects/164fb169a27044d496eeaa677052017a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:19.631631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] RBAC: Authorizing `identity:delete_project(project_id=164fb169a27044d496eeaa677052017a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:19.633810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:19.776334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164fb169a27044d496eeaa677052017a', 'request_id': 'req-2f258acd-ff28-473e-9c89-e0ba902e885d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:19.799477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164fb169a27044d496eeaa677052017a', 'request_id': 'req-2f258acd-ff28-473e-9c89-e0ba902e885d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:19.813591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164fb169a27044d496eeaa677052017a', 'request_id': 'req-2f258acd-ff28-473e-9c89-e0ba902e885d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:19.840712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] The token cache is being invalidate because project 164fb169a27044d496eeaa677052017a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:19.841265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:19.842293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-2f258acd-ff28-473e-9c89-e0ba902e885d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:19.844759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1210/2423] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:19 2022] DELETE /identity/v3/projects/164fb169a27044d496eeaa677052017a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:19.856086 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:19.857590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:19.858304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:19.892176 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:19.895000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:19.995995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1214/2424] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:20.006173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.006577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.006949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.031724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:20.033242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:20.042015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1211/2425] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:20.046707 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.063751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e70f-e247-4b80-8a20-f1fe527d6cfa None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.072105 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.072840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.073262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.073818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.074592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:20.074992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.079507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.097177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:20.124376 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1215/2426] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:20.125610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.137207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5afc6-c8a0-4a48-9c95-11d2a902ab84 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.157413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.158951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.159609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.160331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.161870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.165647 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.175691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:20.258797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1212/2427] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:20 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:20.263959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.280689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2639d-ea19-4ef3-a238-1af0fc54d4bb admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.463822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.464797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.465327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.465853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.467007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.493792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.546769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1216/2428] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:20 2022] POST /identity/v3/users => generated 282 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:20.554669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.584241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f80c7-8d75-49b2-888e-767287bb68cc admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.598396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.599197 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.599551 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.599815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.600517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.602495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.622041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1213/2429] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:20.623256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.650330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31909af0-bbd2-4463-8c58-2260d7313e6b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.662908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.664589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.664589 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.665008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.666688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.669819 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b99fe-d085-4886-8dd2-86df0fa762b2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.688334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1217/2430] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:20.693512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:20.708572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18c8e3-a8f9-4a31-bfdd-7f4c99d5684e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:20.717974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:20.718840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.719092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.719385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] PATH_INFO: `/v3/projects/cb92b1d2365047e6b4a05c6a173c719e/users/af833fc3d5ea4624a272730952427f1d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.767264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb92b1d2365047e6b4a05c6a173c719e, user_id=af833fc3d5ea4624a272730952427f1d, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:20.773642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:20.809737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1214/2431] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:20 2022] PUT /identity/v3/projects/cb92b1d2365047e6b4a05c6a173c719e/users/af833fc3d5ea4624a272730952427f1d/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:20.832542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:20.833089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:20.833553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:20.896066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] MFA Rules not processed for user `af833fc3d5ea4624a272730952427f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:20.897697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:21.072574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1218/2432] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:21.074402 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.221682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e046614-2a52-4167-95cf-822ebb786fe4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.238412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.240297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.241082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.241569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.242515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.246637 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.313310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1215/2433] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:21 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:21.320367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.346510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a360f-5d47-434e-8a22-41d2dad98849 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.474214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.475032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.475417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.475745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.476607 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.478832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.508594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:21.522517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1219/2434] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:21 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:21.526808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.546577 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd210-21c6-42e2-9db6-fed85635e7a8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.555297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.556313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.556801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.557428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.558632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.562817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.589470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1216/2435] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:21.591608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.610617 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143849e4-ae0b-4f15-82c4-ce28651142a8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.618628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.619790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.620284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.620752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] PATH_INFO: `/v3/projects/e665ecc491ce461499bc6fb1b35be57f/users/c590167d9705457da3027b8325fd0417/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.653527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e665ecc491ce461499bc6fb1b35be57f, user_id=c590167d9705457da3027b8325fd0417, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.658684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.697494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1220/2436] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:21 2022] PUT /identity/v3/projects/e665ecc491ce461499bc6fb1b35be57f/users/c590167d9705457da3027b8325fd0417/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:21.702103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.728139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce63f-ad24-4ee9-9323-6446a18c3012 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.848375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.849457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.849909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.850385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.851602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.854675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53bf35-2b59-4f7d-938e-48b4e9995007 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.876947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1217/2437] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:21.882108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:21.905379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa65798-0380-420d-914f-c9d3370a8b6c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:21.913334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:21.914480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.914865 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.915242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] PATH_INFO: `/v3/projects/e665ecc491ce461499bc6fb1b35be57f/users/c590167d9705457da3027b8325fd0417/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:21.918501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e665ecc491ce461499bc6fb1b35be57f, user_id=c590167d9705457da3027b8325fd0417, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:21.922667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:21.949976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1221/2438] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:21 2022] PUT /identity/v3/projects/e665ecc491ce461499bc6fb1b35be57f/users/c590167d9705457da3027b8325fd0417/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:21.965879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:21.966515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:21.966789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:22.018435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] MFA Rules not processed for user `c590167d9705457da3027b8325fd0417`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:22.021784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:22.041483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:22.161432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1218/2439] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:22.179092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:22.181989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:22.299894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c2692-3f15-47fe-b2c9-b0b5c3230fc9 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:22.313141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:22.313919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:22.314199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:22.314543 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:22.331016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:22.332098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4f17e-14a7-443b-bff0-f0e33672a8f3 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:22.349409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1222/2440] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:23.180519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:23.313967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34715-41ed-47bb-b997-cb380d674265 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:23.323088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:23.324620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:23.325063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:23.325430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] PATH_INFO: `/v3/users/af833fc3d5ea4624a272730952427f1d` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:23.327175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af833fc3d5ea4624a272730952427f1d)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:23.329792 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:23.422267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af833fc3d5ea4624a272730952427f1d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.423933 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af833fc3d5ea4624a272730952427f1d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.425392 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af833fc3d5ea4624a272730952427f1d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.457028 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af833fc3d5ea4624a272730952427f1d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.476488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af833fc3d5ea4624a272730952427f1d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.512964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1219/2441] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:23 2022] DELETE /identity/v3/users/af833fc3d5ea4624a272730952427f1d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:23.518118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:23.519397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:23.519920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:23.548228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:23.549696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:23.633822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:23.635604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:23.645070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1223/2442] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:23.659844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:23.663238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:23.676867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d093d-19d1-4380-8efd-f847181501fb admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:23.685299 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:23.686280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:23.686704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:23.687286 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] PATH_INFO: `/v3/users/e16643e375a04492a24e932317b58d66` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:23.690094 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16643e375a04492a24e932317b58d66)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:23.693812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:23.739070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:23.816120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4d816-0c48-40d6-b84f-659a8ed0edbd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:23.823172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16643e375a04492a24e932317b58d66'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.824054 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:23.825058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:23.825460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:23.825747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:23.826565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16643e375a04492a24e932317b58d66'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.828091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16643e375a04492a24e932317b58d66'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.829161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:23.848393 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:23.849953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee1fed-63c1-4399-a6a1-3d79506b7eab service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:23.853326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16643e375a04492a24e932317b58d66'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.870636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16643e375a04492a24e932317b58d66'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:23.872164 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1224/2443] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:23.911519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1220/2444] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:23 2022] DELETE /identity/v3/users/e16643e375a04492a24e932317b58d66 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:23.917995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:23.918222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:23.918343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:23.935889 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:23.946508 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:23.951784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:24.078049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1225/2445] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:24.092313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:24.094598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:24.244409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526359-3197-4a9c-b327-311bf489a2d6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:24.253720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:24.255129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:24.255304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:24.255682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:24.274103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:24.277161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:24.296671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1221/2446] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:24.735320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:24.737004 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:24.756585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb58a3-2775-419f-8952-23433b7d64b7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:24.774006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:24.775141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:24.775625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:24.777058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] PATH_INFO: `/v3/projects/cb92b1d2365047e6b4a05c6a173c719e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:24.780472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb92b1d2365047e6b4a05c6a173c719e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:24.784381 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:24.886473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb92b1d2365047e6b4a05c6a173c719e', 'request_id': 'req-c01aca11-8967-4a59-b2bb-a4b1250c771b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:24.906558 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb92b1d2365047e6b4a05c6a173c719e', 'request_id': 'req-c01aca11-8967-4a59-b2bb-a4b1250c771b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:24.925015 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb92b1d2365047e6b4a05c6a173c719e', 'request_id': 'req-c01aca11-8967-4a59-b2bb-a4b1250c771b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:24.925306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:24.927632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:24.961594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b333-0577-4d77-8832-1ebd8c25ea08 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:24.963439 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] The token cache is being invalidate because project cb92b1d2365047e6b4a05c6a173c719e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:24.964247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:24.965837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:24.968791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1226/2447] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:24 2022] DELETE /identity/v3/projects/cb92b1d2365047e6b4a05c6a173c719e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:24.974386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:24.976592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:25.094463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:25.095620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:25.095915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:25.096290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] PATH_INFO: `/v3/projects/ffd3d72e708d46cba37718f5f54ac099` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:25.098215 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd3d72e708d46cba37718f5f54ac099)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:25.100585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:25.134384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aca11-8967-4a59-b2bb-a4b1250c771b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:25.142052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:25.142779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:25.143079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:25.148604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] PATH_INFO: `/v3/users/c590167d9705457da3027b8325fd0417` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:25.151359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c590167d9705457da3027b8325fd0417)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:25.156750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:25.217967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:25.231323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd3d72e708d46cba37718f5f54ac099', 'request_id': 'req-d3528328-d83e-4084-a02d-dbbc27a111ca'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.239472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:25.253278 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd3d72e708d46cba37718f5f54ac099', 'request_id': 'req-d3528328-d83e-4084-a02d-dbbc27a111ca'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.268791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c590167d9705457da3027b8325fd0417'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.269725 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c590167d9705457da3027b8325fd0417'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.270856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c590167d9705457da3027b8325fd0417'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.271517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd3d72e708d46cba37718f5f54ac099', 'request_id': 'req-d3528328-d83e-4084-a02d-dbbc27a111ca'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.300845 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] The token cache is being invalidate because project ffd3d72e708d46cba37718f5f54ac099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:25.301679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.301852 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c590167d9705457da3027b8325fd0417'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.303422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.310854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1222/2448] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:24 2022] DELETE /identity/v3/projects/ffd3d72e708d46cba37718f5f54ac099 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:25.314267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:25.316687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:25.320539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c590167d9705457da3027b8325fd0417'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.358411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1227/2449] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:24 2022] DELETE /identity/v3/users/c590167d9705457da3027b8325fd0417 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:25.490272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3528328-d83e-4084-a02d-dbbc27a111ca admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:25.640988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:25.642145 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:25.643069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:25.643827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] PATH_INFO: `/v3/users/0fe680f0601c4fbf88b6eac748c9c8ac` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:25.646119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe680f0601c4fbf88b6eac748c9c8ac)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:25.652644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:25.779736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe680f0601c4fbf88b6eac748c9c8ac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.780846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe680f0601c4fbf88b6eac748c9c8ac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.782063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe680f0601c4fbf88b6eac748c9c8ac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.808035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe680f0601c4fbf88b6eac748c9c8ac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.826003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-3224a3fb-113a-4545-afd7-e9064e4ebe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe680f0601c4fbf88b6eac748c9c8ac'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:25.849219 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:25.867223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1223/2450] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:25 2022] DELETE /identity/v3/users/0fe680f0601c4fbf88b6eac748c9c8ac => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:25.922596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:25.929341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:25.969422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45863b4-0d0a-497f-afec-5191ce0c6da8 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.097976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.100046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.100990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.101801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] PATH_INFO: `/v3/projects/e665ecc491ce461499bc6fb1b35be57f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.104923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e665ecc491ce461499bc6fb1b35be57f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.110208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.211210 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e665ecc491ce461499bc6fb1b35be57f', 'request_id': 'req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.228990 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e665ecc491ce461499bc6fb1b35be57f', 'request_id': 'req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.245631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e665ecc491ce461499bc6fb1b35be57f', 'request_id': 'req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.259875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] The token cache is being invalidate because project e665ecc491ce461499bc6fb1b35be57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:26.260265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.261079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.266815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1228/2451] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:25 2022] DELETE /identity/v3/projects/e665ecc491ce461499bc6fb1b35be57f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:26.268491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c715a-921a-426c-98c8-b7ac1c57ca6c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.269315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c715a-921a-426c-98c8-b7ac1c57ca6c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.269315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c715a-921a-426c-98c8-b7ac1c57ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.295805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d79c715a-921a-426c-98c8-b7ac1c57ca6c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:26.297612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d79c715a-921a-426c-98c8-b7ac1c57ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.377257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:26.380241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.407304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1224/2452] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:26.423794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.426129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.426718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.450685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:26.453604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.464552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:26.503206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1225/2453] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:26.508214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:26.517857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60f9a-ff58-44d4-8ac0-09f9971e41e0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.527041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.527398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.527871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.528072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] PATH_INFO: `/v3/projects/80644b3bf8c94f128117d27953dbcd55` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.532994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef013-36ab-44d4-9c48-48f8b048ef0a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.535404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80644b3bf8c94f128117d27953dbcd55)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.537491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.543176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.543827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.544110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.544404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.545179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:26.545490 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.547210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.573891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1226/2454] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:26.581226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:26.600107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c5855-74e4-4f75-8708-52597a4aa769 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.606856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.607169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.607169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.607574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.608122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.610761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.651744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80644b3bf8c94f128117d27953dbcd55', 'request_id': 'req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.666825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1227/2455] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:26.680080 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:26.683034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80644b3bf8c94f128117d27953dbcd55', 'request_id': 'req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.698472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80644b3bf8c94f128117d27953dbcd55', 'request_id': 'req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.719024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] The token cache is being invalidate because project 80644b3bf8c94f128117d27953dbcd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:26.719664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.720785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b076a1f7-ecc6-4b4d-b764-ac3ae48f3d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:26.723956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1229/2456] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:26 2022] DELETE /identity/v3/projects/80644b3bf8c94f128117d27953dbcd55 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:26.730556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75beb-9fb6-419a-bae4-25fd8049786b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.731678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75beb-9fb6-419a-bae4-25fd8049786b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.731678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75beb-9fb6-419a-bae4-25fd8049786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.771475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-43b75beb-9fb6-419a-bae4-25fd8049786b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:26.776726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-43b75beb-9fb6-419a-bae4-25fd8049786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.801506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2087b1-f312-4f19-81aa-2bceb02d1cf9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.808754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.809561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.809903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.810282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.811129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.813122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.854862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1228/2457] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:26.869238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:26.874195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.934482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1230/2458] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:26.946346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a077-b875-4944-a194-253c95a10297 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:26.951982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b54df-f960-40de-8962-642e5ba91228 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.953114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b54df-f960-40de-8962-642e5ba91228 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.953774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b54df-f960-40de-8962-642e5ba91228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.958078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:26.960042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:26.960995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:26.961631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:26.963797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:26.967937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:26.982432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-033b54df-f960-40de-8962-642e5ba91228 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:26.984782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-033b54df-f960-40de-8962-642e5ba91228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:26.991820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1229/2459] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:26.997375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.000513 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1231/2460] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:27.006357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b54df-f960-40de-8962-642e5ba91228 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.022890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417653cb-aa09-49a7-bee1-290561489476 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.023984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b54df-f960-40de-8962-642e5ba91228 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.033340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.034327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.034769 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.035057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.035733 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.035894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.036487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.036820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.037217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.037976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:27.038200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.038399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.040342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.061283 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1232/2461] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:27.062172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1230/2462] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:27.062791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.062995 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.079305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929832e-52ec-4938-861a-d8bd372f0a44 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.088626 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.089347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.089614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.089915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.090753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.093483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.100213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404460d-cb65-40db-a206-2171b161de41 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.112133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.112950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.113292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.113568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] PATH_INFO: `/v3/projects/10e2ada147fa49eeafc5f264eb569ba4/users/7854f09b28ad425d9effe9170ca279dd/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.138371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e2ada147fa49eeafc5f264eb569ba4, user_id=7854f09b28ad425d9effe9170ca279dd, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.142029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757dd38-5cee-4c74-a07c-ff0b4bad29f2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.144924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1233/2463] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:27.153842 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.165775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:27.173974 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1231/2464] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:27 2022] PUT /identity/v3/projects/10e2ada147fa49eeafc5f264eb569ba4/users/7854f09b28ad425d9effe9170ca279dd/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:27.196942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:27.199775 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218aea-b656-436b-8aae-270b7f630308 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.203022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218aea-b656-436b-8aae-270b7f630308 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.203870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218aea-b656-436b-8aae-270b7f630308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.239104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972196b-1bd5-4bea-a225-d9a55a74983e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.260328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-55218aea-b656-436b-8aae-270b7f630308 None None] MFA Rules not processed for user `7854f09b28ad425d9effe9170ca279dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:27.262980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-55218aea-b656-436b-8aae-270b7f630308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:27.369131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1232/2465] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:27.377050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218aea-b656-436b-8aae-270b7f630308 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.380201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.381401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.381955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.383827 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.391532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.395636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.403926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218aea-b656-436b-8aae-270b7f630308 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.413613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.415222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.415928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.417547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.419021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.422728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.445129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1234/2466] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:27.446710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.464478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a3849-0751-4f6d-8152-41a6bf6d527d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.478003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.479171 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.479666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.480304 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.481485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.484698 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.489634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1233/2467] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:27.494509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.509750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1235/2468] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:27.514447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.549262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccaa5c-64ce-4c58-b13d-4d74bcef0ded admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.636296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87ffb4-118d-4e99-89df-5ba097d88800 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.643212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.643877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.644171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.644430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.645079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.650292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.671986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.674630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.674630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.674630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.675978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.679509 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.681476 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1234/2469] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:27.692724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.704527 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1236/2470] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:27.707351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.708562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6024771-c5b8-4941-9750-606ef1663b27 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.714666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.715385 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.715778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.716144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.716889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.719453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.725874 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5eccf-bf51-4468-9164-ff9919c82686 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.734552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.735869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.736552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.737211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] PATH_INFO: `/v3/projects/78f6fa76832d44b98f97f8d46f0490ba/users/416092a1e3a943b591af98ad562c81a4/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.743342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1235/2471] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:27.744564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.766833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f6fa76832d44b98f97f8d46f0490ba, user_id=416092a1e3a943b591af98ad562c81a4, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.768093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57308016-a2e0-41e1-9dbb-70a2f546b8a9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:27.773292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6948e61-1526-4112-a04e-804964c0b48c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.776518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:27.778016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.778482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.779184 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] PATH_INFO: `/v3/projects/add1b90c4ed04dcdb02794d01b0a799e/users/70404b8893f94e3fbba815df863f3df6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.812007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1237/2472] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:27 2022] PUT /identity/v3/projects/78f6fa76832d44b98f97f8d46f0490ba/users/416092a1e3a943b591af98ad562c81a4/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:27.814705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:27.815284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:27.816134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:27.846670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add1b90c4ed04dcdb02794d01b0a799e, user_id=70404b8893f94e3fbba815df863f3df6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:27.850525 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:27.877238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1236/2473] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:27 2022] PUT /identity/v3/projects/add1b90c4ed04dcdb02794d01b0a799e/users/70404b8893f94e3fbba815df863f3df6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:27.878532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] MFA Rules not processed for user `416092a1e3a943b591af98ad562c81a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:27.878672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:27.879959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:27.904326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:27.937467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:28.010387 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1238/2474] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:28.017325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.029798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3fab-e18f-4fdd-a345-a5f5a1e00887 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.031670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153edea5-395f-4e8f-aea3-0bba60af8a11 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.043469 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.044814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.044814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.045868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.046918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.047856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.049812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.049812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.050423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.050683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.052088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.055340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.077884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1237/2475] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:28.084187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.111827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad957c2-d0e0-4de3-9bfb-48540a591d69 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.119531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.120739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.121236 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.121704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] PATH_INFO: `/v3/projects/add1b90c4ed04dcdb02794d01b0a799e/users/70404b8893f94e3fbba815df863f3df6/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.125576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1239/2476] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:28.125764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=add1b90c4ed04dcdb02794d01b0a799e, user_id=70404b8893f94e3fbba815df863f3df6, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.126959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.130288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692185c8-3eb5-47d3-852c-6095f92d44ff admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.151875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1238/2477] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:28 2022] PUT /identity/v3/projects/add1b90c4ed04dcdb02794d01b0a799e/users/70404b8893f94e3fbba815df863f3df6/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:28.171889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.172757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.173782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.232982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] MFA Rules not processed for user `70404b8893f94e3fbba815df863f3df6`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:28.234364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:28.257318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab664-bed4-4c20-8fe2-7a83d8844d6b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.393218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.394388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.394942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.395428 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.396502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.402228 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.413898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1239/2478] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:28.432052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.435298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:28.455340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1240/2479] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:28 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:28.457673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.474646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756220f-d996-421b-8de4-cbb712ad6c11 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.485155 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.486290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.486793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.489073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.490515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.493745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.520223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1241/2480] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:28.522526 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.540482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9e91-9204-44f2-970a-b32a832883a6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.551297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.552770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.553290 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.553995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] PATH_INFO: `/v3/projects/937c6d5275424a2180c242a386a89b40/users/365bf55642274684a854adc1837a82b7/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.565370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cee0c9-f5d1-4fc8-bc35-8b164a05988d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.581737 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.583206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.583901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.584940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.603897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.606672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.624683 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1240/2481] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:28.636423 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] RBAC: Authorizing `identity:create_grant(project_id=937c6d5275424a2180c242a386a89b40, user_id=365bf55642274684a854adc1837a82b7, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.642955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.650748 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:28.683207 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1242/2482] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:28 2022] PUT /identity/v3/projects/937c6d5275424a2180c242a386a89b40/users/365bf55642274684a854adc1837a82b7/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:28.690129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.712023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5cce0-c705-4c35-a0bf-48e38a9cfc9f service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.800742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:28.864570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.866508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.867371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.868151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.870414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.874625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5196b6-e9b3-44dc-a37c-a63adc7d6b55 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.896842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1241/2483] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:28.902923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:28.917097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675e8c2-7ea1-4fb1-ab1a-580ec3c9707b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:28.922915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:28.923630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.923902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.924462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] PATH_INFO: `/v3/projects/937c6d5275424a2180c242a386a89b40/users/365bf55642274684a854adc1837a82b7/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:28.926745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937c6d5275424a2180c242a386a89b40, user_id=365bf55642274684a854adc1837a82b7, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:28.930339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:28.947965 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1243/2484] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:28 2022] PUT /identity/v3/projects/937c6d5275424a2180c242a386a89b40/users/365bf55642274684a854adc1837a82b7/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:28.968289 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:28.968684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:28.969059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:29.034388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] MFA Rules not processed for user `365bf55642274684a854adc1837a82b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:29.036542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:29.197764 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1242/2485] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:29.227435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:29.379661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eccc-6307-43e9-a021-a1fd5052d272 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:29.392645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:29.398367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:29.398724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:29.399095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:29.557312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:29.560337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:29.592008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1244/2486] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:31.417048 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:31.419413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:31.439629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d88f-7be5-4346-a7a3-5e6d7bc1dde9 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:31.448393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:31.449590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:31.450075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:31.450214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:31.451327 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:31.464624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:31.466439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d79a68-f932-4004-91ed-de31ae7ba11e service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:31.482368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1243/2487] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:31.596670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63407a-c3d8-45e1-aa79-5be280b591bc service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:31.606542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:31.607595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:31.607989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:31.608426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] PATH_INFO: `/v3/users/7854f09b28ad425d9effe9170ca279dd` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:31.610123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7854f09b28ad425d9effe9170ca279dd)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:31.613073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:31.707666 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:31.728651 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7854f09b28ad425d9effe9170ca279dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:31.730970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7854f09b28ad425d9effe9170ca279dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:31.732701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7854f09b28ad425d9effe9170ca279dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:31.755349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7854f09b28ad425d9effe9170ca279dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:31.785963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7854f09b28ad425d9effe9170ca279dd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:31.821013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1245/2488] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:31 2022] DELETE /identity/v3/users/7854f09b28ad425d9effe9170ca279dd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:31.827553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:31.827992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:31.828347 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:31.858185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:31.859504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:31.949177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1244/2489] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:31.957273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:31.959876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:32.088216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03d7e-ca91-438c-84a7-2c9aa51b4e1d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:32.100129 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:32.101831 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:32.102317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:32.102770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:32.125568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:32.129479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:32.150780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1246/2490] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:32.746982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:32.749967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:32.779472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294f509-2c3f-4f63-bbb4-ae41c7f898f6 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:32.804798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:32.806308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:32.807032 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:32.807516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] PATH_INFO: `/v3/projects/10e2ada147fa49eeafc5f264eb569ba4` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:32.812410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e2ada147fa49eeafc5f264eb569ba4)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:32.819988 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:32.916258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:32.948943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e2ada147fa49eeafc5f264eb569ba4', 'request_id': 'req-b93e8779-c496-4f50-823a-96d6ee9ed0f0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:32.962265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e2ada147fa49eeafc5f264eb569ba4', 'request_id': 'req-b93e8779-c496-4f50-823a-96d6ee9ed0f0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:32.973243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e2ada147fa49eeafc5f264eb569ba4', 'request_id': 'req-b93e8779-c496-4f50-823a-96d6ee9ed0f0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.016668 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] The token cache is being invalidate because project 10e2ada147fa49eeafc5f264eb569ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:33.017743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.020354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.027521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1245/2491] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:32 2022] DELETE /identity/v3/projects/10e2ada147fa49eeafc5f264eb569ba4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:33.028443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:33.044422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9936f-47b7-4246-b4b7-52691423f596 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:33.193126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:33.193851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:33.194127 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:33.194448 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] PATH_INFO: `/v3/users/70404b8893f94e3fbba815df863f3df6` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:33.198120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] RBAC: Authorizing `identity:delete_user(user_id=70404b8893f94e3fbba815df863f3df6)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:33.201610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:33.378776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70404b8893f94e3fbba815df863f3df6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.381694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70404b8893f94e3fbba815df863f3df6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.383138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70404b8893f94e3fbba815df863f3df6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.413721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:33.423845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70404b8893f94e3fbba815df863f3df6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.439870 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b32b22e5-3890-4e60-96b1-784746b4bead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70404b8893f94e3fbba815df863f3df6'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:33.495063 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1247/2492] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:33 2022] DELETE /identity/v3/users/70404b8893f94e3fbba815df863f3df6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:34.175596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:34.177902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:34.197287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8779-c496-4f50-823a-96d6ee9ed0f0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:34.339880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:34.341552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:34.342442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:34.342660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] PATH_INFO: `/v3/projects/add1b90c4ed04dcdb02794d01b0a799e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:34.344700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=add1b90c4ed04dcdb02794d01b0a799e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:34.348849 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:34.500536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add1b90c4ed04dcdb02794d01b0a799e', 'request_id': 'req-65af396d-6e0e-478b-809a-217d44e26458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:34.518891 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add1b90c4ed04dcdb02794d01b0a799e', 'request_id': 'req-65af396d-6e0e-478b-809a-217d44e26458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:34.537606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add1b90c4ed04dcdb02794d01b0a799e', 'request_id': 'req-65af396d-6e0e-478b-809a-217d44e26458'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:34.563364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] The token cache is being invalidate because project add1b90c4ed04dcdb02794d01b0a799e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:34.563852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:34.564681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-65af396d-6e0e-478b-809a-217d44e26458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:34.568142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1246/2493] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:34 2022] DELETE /identity/v3/projects/add1b90c4ed04dcdb02794d01b0a799e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:34.574618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:34.576058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:34.577201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:34.641800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:34.645692 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:34.828644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1248/2494] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:34.833556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:34.834396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:34.835254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:34.945040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:34.946449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:34.995154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1247/2495] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:35.002502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.040968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2dd66-4e96-4cde-869c-a1554ad45fd2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.053856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.056569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.057443 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.058854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.063223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:35.064130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.067574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.109646 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1249/2496] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:35.114447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.129187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c550e9-f956-4f33-8f61-067d36d3819a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.138225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.139216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.139935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.140317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.141281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.144242 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.205257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1248/2497] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:35 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:35.227737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.249343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a494-014d-4b32-89ec-3a943c4d582e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.418828 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.419801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.421494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.424873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.426380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.430691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.485740 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1250/2498] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:35 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:35.489601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.509967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5cc5-53cf-4f14-a7ff-63302b18376e admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.519262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.527984 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.529063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.529831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.531620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.535255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.563066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1249/2499] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:35.569153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.592050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42db119-3a8d-44f1-a198-12f4585faeb0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.600789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.601592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.602075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.602718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.603461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.605612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17866c0-3c26-47f1-9f65-463198922258 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.618764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1251/2500] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:35.626397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:35.641743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455953d-a7b6-40f6-88fe-b0481cf108fd admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:35.650628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:35.651689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.652149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.652651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] PATH_INFO: `/v3/projects/967560825a4e471b8cdc3287102b33ee/users/6f5a04f219da46b1b68abdf68abdcf6a/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.672673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:35.689759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] RBAC: Authorizing `identity:create_grant(project_id=967560825a4e471b8cdc3287102b33ee, user_id=6f5a04f219da46b1b68abdf68abdcf6a, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:35.696135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:35.725689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1250/2501] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:35 2022] PUT /identity/v3/projects/967560825a4e471b8cdc3287102b33ee/users/6f5a04f219da46b1b68abdf68abdcf6a/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:35.743855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:35.744581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:35.745288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:35.824547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] MFA Rules not processed for user `6f5a04f219da46b1b68abdf68abdcf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:35.827694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:35.888230 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:35.967706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1252/2502] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:35.974915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.147749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde527-347d-4b1d-abfb-ee03f75a443b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:36.157234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:36.158625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.159281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.159926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.161281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:36.165034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:36.176130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.180123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:36.227815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b5964-a69d-4d87-9734-f56d7676a7e6 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:36.236347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:36.237682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.238202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.238746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] PATH_INFO: `/v3/users/416092a1e3a943b591af98ad562c81a4` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.240773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416092a1e3a943b591af98ad562c81a4)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:36.241439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1251/2503] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:35 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:36.244785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:36.245043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.346521 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416092a1e3a943b591af98ad562c81a4'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:36.354685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416092a1e3a943b591af98ad562c81a4'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:36.356535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416092a1e3a943b591af98ad562c81a4'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:36.389857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416092a1e3a943b591af98ad562c81a4'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:36.408869 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd22241-554c-4350-9a93-10831ef7a0f3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:36.416361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-932227d3-1efb-4204-8439-5713cdf1e200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416092a1e3a943b591af98ad562c81a4'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:36.434959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:36.436735 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.437501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.438258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.439484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:36.444482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:36.457490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1253/2504] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:36 2022] DELETE /identity/v3/users/416092a1e3a943b591af98ad562c81a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:36.459506 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.460007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.460346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.508254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:36.511074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:36.514101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1252/2505] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:36 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:36.521471 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.532374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:36.553003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b977-aab3-4c33-a6b6-9cd572593447 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:36.673671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:36.674513 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.674928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.675272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.676053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:36.677875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:36.690381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1253/2506] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:36.698437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.706005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:36.714042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b050-4827-454a-8f9e-ceed66bdbc61 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:36.722108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:36.723391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:36.724108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:36.724680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] PATH_INFO: `/v3/projects/86f694d66c38470c9b920f0a75c4b812/users/7948293131f24a8d839750810b8a514b/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:36.735754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1254/2507] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:36.773467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.778700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f694d66c38470c9b920f0a75c4b812, user_id=7948293131f24a8d839750810b8a514b, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:36.784034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:36.788656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:36.822196 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1254/2508] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:36 2022] PUT /identity/v3/projects/86f694d66c38470c9b920f0a75c4b812/users/7948293131f24a8d839750810b8a514b/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:36.827659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:36.987055 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:37.011927 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362f8b-1cbe-49ac-be2f-99cad6a308ad None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:37.112998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ac40a-0b1d-4683-9eb3-f93cf0f65c0f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:37.128625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:37.129800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:37.130318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:37.130916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:37.132083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:37.143104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:37.173876 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1255/2509] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:37.178418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:37.181940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:37.183383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:37.184407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:37.185083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:37.191534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a4ae-f338-4e14-b02b-9435055f6ba7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:37.199131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:37.199964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:37.200398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:37.200856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] PATH_INFO: `/v3/projects/86f694d66c38470c9b920f0a75c4b812/users/7948293131f24a8d839750810b8a514b/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:37.204489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f694d66c38470c9b920f0a75c4b812, user_id=7948293131f24a8d839750810b8a514b, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:37.207548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6088663-bdb6-4401-a44c-f7b1a5c9e22a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:37.208873 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:37.210562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:37.230405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1256/2510] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:37 2022] PUT /identity/v3/projects/86f694d66c38470c9b920f0a75c4b812/users/7948293131f24a8d839750810b8a514b/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:37.242572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:37.242572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:37.243130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:37.246747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1255/2511] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:37.350499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] MFA Rules not processed for user `7948293131f24a8d839750810b8a514b`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:37.353047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:37.653479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1257/2512] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:37.668977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:37.671444 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:37.842165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66ac1-95b4-4091-bd35-a47bf017af41 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:37.915852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:37.917670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:37.997117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:38.026343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:38.027398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:38.027876 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:38.028349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:38.030720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a052a4d-b8c0-4b1b-9e24-5ec960814546 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:38.039284 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:38.040275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:38.041134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:38.042020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] PATH_INFO: `/v3/projects/78f6fa76832d44b98f97f8d46f0490ba` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:38.044627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f6fa76832d44b98f97f8d46f0490ba)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:38.050502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:38.059988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:38.107729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:38.152503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1256/2513] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:38.262446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f6fa76832d44b98f97f8d46f0490ba', 'request_id': 'req-693cae23-9e99-482e-8bd3-1735d4064fe1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.293572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f6fa76832d44b98f97f8d46f0490ba', 'request_id': 'req-693cae23-9e99-482e-8bd3-1735d4064fe1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.313171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f6fa76832d44b98f97f8d46f0490ba', 'request_id': 'req-693cae23-9e99-482e-8bd3-1735d4064fe1'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.338492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] The token cache is being invalidate because project 78f6fa76832d44b98f97f8d46f0490ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:38.338998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.341334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.344713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1258/2514] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:37 2022] DELETE /identity/v3/projects/78f6fa76832d44b98f97f8d46f0490ba => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:38.351312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:38.405298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2cbf-70e5-4260-8b4a-51b6cdd75b37 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:38.473677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:38.476944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:38.570482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:38.571335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:38.571736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:38.572104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] PATH_INFO: `/v3/users/365bf55642274684a854adc1837a82b7` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:38.573510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=365bf55642274684a854adc1837a82b7)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:38.577201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:38.584223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:38.646203 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cae23-9e99-482e-8bd3-1735d4064fe1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:38.658212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:38.659826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:38.661422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:38.666019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:38.670669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:38.732654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365bf55642274684a854adc1837a82b7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.733832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365bf55642274684a854adc1837a82b7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.734963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365bf55642274684a854adc1837a82b7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.773776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365bf55642274684a854adc1837a82b7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.797195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365bf55642274684a854adc1837a82b7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:38.865384 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1257/2515] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:38 2022] DELETE /identity/v3/users/365bf55642274684a854adc1837a82b7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:38.878350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:38.881269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10abf38-fff5-4d74-9dc7-f2f7c36408c1 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:38.901349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1259/2516] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:39.495313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:39.497571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:39.786410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8292-030d-49d2-84a9-0e37301fc93e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:39.801697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:39.803167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:39.803697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:39.804078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] PATH_INFO: `/v3/projects/937c6d5275424a2180c242a386a89b40` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:39.806239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937c6d5275424a2180c242a386a89b40)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:39.810128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:39.971156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937c6d5275424a2180c242a386a89b40', 'request_id': 'req-dee8081c-c828-49de-9b45-d217d9b6ca30'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:39.989988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937c6d5275424a2180c242a386a89b40', 'request_id': 'req-dee8081c-c828-49de-9b45-d217d9b6ca30'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:40.012826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937c6d5275424a2180c242a386a89b40', 'request_id': 'req-dee8081c-c828-49de-9b45-d217d9b6ca30'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:40.035265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] The token cache is being invalidate because project 937c6d5275424a2180c242a386a89b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:40.035735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:40.036802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dee8081c-c828-49de-9b45-d217d9b6ca30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:40.039121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1258/2517] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:39 2022] DELETE /identity/v3/projects/937c6d5275424a2180c242a386a89b40 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:40.048212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.049213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.049213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.109321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:40.112305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:40.211803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:40.321470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1260/2518] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:40.336674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.340169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.340169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.382973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:40.387858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:40.403636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1259/2519] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:40.410958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:40.425763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cbdf7-61f1-4fbc-adc8-63de17af6480 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:40.430749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:40.434826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.434826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.434826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.435547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:40.436142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:40.439423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:40.462091 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1261/2520] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:40.473916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:40.506084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a93f89-3347-46ab-854d-6813ce3281c5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:40.522967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:40.524540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.525339 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.526134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.527353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:40.531490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:40.541347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:40.641282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:40.641776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1260/2521] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:40 2022] POST /identity/v3/projects => generated 407 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:40.657975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762757aa-0ac1-4374-9b36-03f08a87f5c3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:40.877171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:40.878393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.879119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.879617 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.880655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:40.883645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:40.929252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1262/2522] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:40 2022] POST /identity/v3/users => generated 304 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:40.931632 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:40.959690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b59b12-c046-45f6-bb91-05c506a79a9f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:40.965919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:40.969068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:40.969369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:40.969647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:40.970404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:40.972700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.006653 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1261/2523] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:41.009620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.031899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55205bbb-97af-48ca-ba62-4c4f030e9d6f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.042964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.043628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.043921 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.044195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.045255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.046620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05008c0-24b8-4986-8aa1-ca5cfc9502e4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.069720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1263/2524] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:41.076987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.094133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1b11c-e89a-47b7-94a1-ca44a1de1258 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.102989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.105005 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.105801 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.106744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] PATH_INFO: `/v3/projects/2821c0ad67e74707b22c10120283b650/users/2cd2dceadb3542269cfe0b918dc1b761/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.158202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2821c0ad67e74707b22c10120283b650, user_id=2cd2dceadb3542269cfe0b918dc1b761, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.164187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.203710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1262/2525] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:41 2022] PUT /identity/v3/projects/2821c0ad67e74707b22c10120283b650/users/2cd2dceadb3542269cfe0b918dc1b761/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:41.228039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.228831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.229281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.263965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] MFA Rules not processed for user `2cd2dceadb3542269cfe0b918dc1b761`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:41.265598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:41.354456 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1264/2526] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:41.361796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.456050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e482fa-5feb-4b18-8f6a-c90e211ed01a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.462968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.463844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.464133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.464462 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.465329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.467585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.500997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1263/2527] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:41 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:41.506487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.524942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f9234-5489-412a-ba83-8e70584b6eca None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.561001 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:41.605092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.605860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.606221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.606599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.607409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.609569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.635747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1265/2528] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:41 2022] POST /identity/v3/users => generated 311 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:41.642669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.660046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167dc8c-3506-4b89-9694-de88fe5b4c18 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.666668 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.667385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.667658 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.667921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.668586 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.670587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.682591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1264/2529] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:41.687536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.699502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c7f05-d842-4338-ae2a-2f3540c06cb2 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.705177 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.706329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.706514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.706780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] PATH_INFO: `/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e/users/1c8bf38d12d74afc855c1ef66a88c142/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.725162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2e36fd5a9746d6b451ccdf136aee6e, user_id=1c8bf38d12d74afc855c1ef66a88c142, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.728369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.747585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1266/2530] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:41 2022] PUT /identity/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e/users/1c8bf38d12d74afc855c1ef66a88c142/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:41.751972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.763071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5118c00-6402-4f45-bd53-d66f4760b79a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.833662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.834288 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.834568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.834833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.835484 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.837211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04366a65-edaf-4c17-b196-f71bbdd2100b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.848920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1265/2531] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:41.853752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:41.865323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847a4d-5bdd-424d-8624-fce54ff7c40d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:41.870597 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:41.871328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.871644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.871952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] PATH_INFO: `/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e/users/1c8bf38d12d74afc855c1ef66a88c142/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.874131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2e36fd5a9746d6b451ccdf136aee6e, user_id=1c8bf38d12d74afc855c1ef66a88c142, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:41.877371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:41.888978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1267/2532] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:41 2022] PUT /identity/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e/users/1c8bf38d12d74afc855c1ef66a88c142/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:41.907043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:41.907327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:41.907611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:41.947981 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] MFA Rules not processed for user `1c8bf38d12d74afc855c1ef66a88c142`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:41.949736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:41.963391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:42.046845 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1266/2533] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:42.058961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:42.060966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:42.144407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90448d-4f0a-4223-a998-43918a9098ef admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:42.148644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:42.149323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:42.149604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:42.149872 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:42.160345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:42.161860 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc69cd-e2f6-4086-a028-6eed046299e7 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:42.173110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1268/2534] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:42.502053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:42.519153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a455d-5b86-4e6b-8591-c99922ccd133 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:42.523638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:42.524370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:42.524714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:42.525280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:42.601582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:42.602786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:42.603258 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:42.640484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:42.642791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:42.654163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:42.656989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:42.674604 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1267/2535] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:42 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:42.758383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1269/2536] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:51:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:42.776806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:42.778683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:42.907038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039e5d3-3807-48e4-8e7b-639c33fc5478 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:42.912118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:42.912758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:42.913079 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:42.913355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:42.924093 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:42.926201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:42.942792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1268/2537] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:51:43.820945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:43.822185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:43.855935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:43.887224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4e10-6ef6-413b-95a5-03730646157c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:43.891298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:43.891966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:43.892240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:43.892506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:43.894395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:43.988292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:43.990942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:44.004971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1270/2538] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:45.336367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:45.338605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.340592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:45.344560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.365822 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096658c-6d69-4e62-8c7d-e241d339f0b2 service swift] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:45.374982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:45.377622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:45.378427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:45.379215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] PATH_INFO: `/v3/users/6f5a04f219da46b1b68abdf68abdcf6a` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:45.381918 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5a04f219da46b1b68abdf68abdcf6a)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:45.384584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:45.447240 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:45.488445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5a04f219da46b1b68abdf68abdcf6a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.489576 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5a04f219da46b1b68abdf68abdcf6a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.490973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5a04f219da46b1b68abdf68abdcf6a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.509983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafc91-c087-4236-a4e1-0a940f0650df service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:45.515466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5a04f219da46b1b68abdf68abdcf6a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.519684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:45.521387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:45.521890 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:45.522657 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:45.524297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5a04f219da46b1b68abdf68abdcf6a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.525839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.541562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1269/2539] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:45 2022] DELETE /identity/v3/users/6f5a04f219da46b1b68abdf68abdcf6a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:45.542703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:45.544217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.556830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:45.559946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b35b-3469-45ee-9667-935782655d6f service placement] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:45.587445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1271/2540] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:45.587644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:45.588997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:45.595010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:45.650170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:45.651681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.692945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bf967-b1a7-4ab2-a984-85f180591098 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:45.701815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:45.702950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:45.703436 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:45.706051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] PATH_INFO: `/v3/users/6501f1cadbaf4e1781586b002a64d8fd` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:45.707323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6501f1cadbaf4e1781586b002a64d8fd)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:45.710350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:45.758880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1272/2541] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:45.774588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:45.777634 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:45.795507 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:45.810263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6501f1cadbaf4e1781586b002a64d8fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.811077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6501f1cadbaf4e1781586b002a64d8fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.811785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6501f1cadbaf4e1781586b002a64d8fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.833818 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6501f1cadbaf4e1781586b002a64d8fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.851997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6501f1cadbaf4e1781586b002a64d8fd'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:45.883602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1270/2542] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:45 2022] DELETE /identity/v3/users/6501f1cadbaf4e1781586b002a64d8fd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:45.904929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652321e-ec57-45ee-acf5-8aed57395d44 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:46.016625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:46.018111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:46.019004 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:46.019517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:46.022782 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:46.180630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:46.182352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982c1c-efae-416b-b017-726fefb19e70 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:46.214766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1273/2543] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:46.349212 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:46.353096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:46.390186 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415037b-773d-4e3b-b2e4-6133eae52b20 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:46.408113 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:46.410257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:46.410970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:46.411523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] PATH_INFO: `/v3/projects/f72568c99367434f8a68f5801bfce72f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:46.414307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72568c99367434f8a68f5801bfce72f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:46.417117 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:46.452618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:46.572643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72568c99367434f8a68f5801bfce72f', 'request_id': 'req-f497a36b-4d2e-4dd8-8543-42ec46670994'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:46.588985 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72568c99367434f8a68f5801bfce72f', 'request_id': 'req-f497a36b-4d2e-4dd8-8543-42ec46670994'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:46.601816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72568c99367434f8a68f5801bfce72f', 'request_id': 'req-f497a36b-4d2e-4dd8-8543-42ec46670994'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:46.619956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] The token cache is being invalidate because project f72568c99367434f8a68f5801bfce72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:46.621041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:46.623278 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:46.625968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1271/2544] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:46 2022] DELETE /identity/v3/projects/f72568c99367434f8a68f5801bfce72f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:46.634399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debcb5-f948-41d7-be30-18763063d8f3 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:46.635263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debcb5-f948-41d7-be30-18763063d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:46.635692 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76debcb5-f948-41d7-be30-18763063d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:46.683834 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-76debcb5-f948-41d7-be30-18763063d8f3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:46.685275 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-76debcb5-f948-41d7-be30-18763063d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:46.815188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:46.817089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:46.880994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1274/2545] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:46.894488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:46.895408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:46.896283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:46.935384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:46.938445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:46.950740 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1275/2546] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:46.957691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:46.975482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1be9a-5673-44fd-87a7-ec9d9851b44f None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:46.986336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:46.987089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:46.987573 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:46.988434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:46.990687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:46.990894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a36b-4d2e-4dd8-8543-42ec46670994 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:46.990996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:46.995043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.000267 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:47.020269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.022391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.025708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.026156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] PATH_INFO: `/v3/projects/967560825a4e471b8cdc3287102b33ee` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.045534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=967560825a4e471b8cdc3287102b33ee)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.047214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1276/2547] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:47.051785 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.053470 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.073218 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79accb-d42f-426c-afbd-c0c378e67e26 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.084389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.086092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.086550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.086964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.089295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.092266 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.155298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1277/2548] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:47 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:47.158135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.185011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967560825a4e471b8cdc3287102b33ee', 'request_id': 'req-40efa949-a670-405b-8543-6ad78bf9c82a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.204723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967560825a4e471b8cdc3287102b33ee', 'request_id': 'req-40efa949-a670-405b-8543-6ad78bf9c82a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.223403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967560825a4e471b8cdc3287102b33ee', 'request_id': 'req-40efa949-a670-405b-8543-6ad78bf9c82a'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.249749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] The token cache is being invalidate because project 967560825a4e471b8cdc3287102b33ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:47.250458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.255995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.260956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1272/2549] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:46 2022] DELETE /identity/v3/projects/967560825a4e471b8cdc3287102b33ee => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:47.264887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.266739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:47.307655 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f25c7-0f5b-4fc2-97e0-f83c914c4382 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.316331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.316777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.317290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.317954 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.318913 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.321749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.359702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:47.388169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1278/2550] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:47 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:47.389056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.391441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:47.403998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa949-a670-405b-8543-6ad78bf9c82a admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.404571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b171a5-c34e-4ecd-a4f3-88ba633d89df admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.410302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.410603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.412665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.412841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.413021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.413188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.413365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.413503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] PATH_INFO: `/v3/users/7948293131f24a8d839750810b8a514b` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.413659 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.413793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7948293131f24a8d839750810b8a514b)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.414109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.416069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.425481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1279/2551] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:47.429285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.440523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4ddab-adff-4b7f-b06b-15fa2cee38d6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.445843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.446612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.446893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.447164 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.447811 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.449736 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.471207 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1280/2552] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:47.476086 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.494364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947acf0-8b70-4ad4-a14f-4a933bf4da49 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.499956 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.500804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.501146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.501424 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] PATH_INFO: `/v3/projects/66a9e1bac95741b48ebc46222814622d/users/510b6f993c4c47c59c936e3493d63fec/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.508539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7948293131f24a8d839750810b8a514b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.509732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7948293131f24a8d839750810b8a514b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.510703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7948293131f24a8d839750810b8a514b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.523063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a9e1bac95741b48ebc46222814622d, user_id=510b6f993c4c47c59c936e3493d63fec, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.528346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330567-57e3-4cd9-94de-8f1acea1b684 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.532298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7948293131f24a8d839750810b8a514b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.547982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7948293131f24a8d839750810b8a514b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:47.551865 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1281/2553] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:47 2022] PUT /identity/v3/projects/66a9e1bac95741b48ebc46222814622d/users/510b6f993c4c47c59c936e3493d63fec/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:47.553302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.553603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.553856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.573089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1273/2554] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:47 2022] DELETE /identity/v3/users/7948293131f24a8d839750810b8a514b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:47.576936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:47.578201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:47.669504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1282/2555] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:47.682359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:47.688027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:47.823307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f85c79-f0fc-466f-a4b5-72dfbe778956 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:47.831720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:47.831720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:47.831720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:47.831720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:47.846369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:47.849308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d491-4ad9-4fe2-9fcb-fc8a795a08b8 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:47.887420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1274/2556] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:48.122132 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:48.124624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:48.149075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e81a0-7cd4-43c1-a877-2072db7b3681 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:48.164097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:48.167093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:48.169046 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:48.170542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] PATH_INFO: `/v3/projects/86f694d66c38470c9b920f0a75c4b812` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:48.175304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f694d66c38470c9b920f0a75c4b812)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:48.177967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:48.196293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:48.291126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f694d66c38470c9b920f0a75c4b812', 'request_id': 'req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:48.311713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f694d66c38470c9b920f0a75c4b812', 'request_id': 'req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:48.327783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f694d66c38470c9b920f0a75c4b812', 'request_id': 'req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:48.349140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] The token cache is being invalidate because project 86f694d66c38470c9b920f0a75c4b812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:48.350019 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:48.350968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-847cba1c-c3b0-4c20-8ea5-7700f9083fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:48.362632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1283/2557] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:48 2022] DELETE /identity/v3/projects/86f694d66c38470c9b920f0a75c4b812 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:48.363480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:48.363480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:48.363480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:48.403697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:48.405487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:48.518346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:48.545416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1275/2558] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:48.552973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:48.553464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:48.553955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:48.593189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:48.594756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:48.608613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1284/2559] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:48.614792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:48.651867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfb533-1471-4cfb-ba62-cd071ceb898d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:48.664958 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:48.667116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:48.667722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:48.669685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:48.670936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:48.671466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:48.675949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:48.701232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1276/2560] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:48.709364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:48.730217 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f49e-2cbe-4ee2-9675-4754e7867c68 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:48.738640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:48.741013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:48.741535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:48.741998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:48.743074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:48.745967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:48.826928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:48.827567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1285/2561] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:48 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:48.845070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c3c87-7454-4f6e-8f3b-7b2585353075 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.005726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.007082 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.007274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.007546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.008995 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.015552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.067276 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1277/2562] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:48 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:49.073394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.095193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f97f2-4cbf-408b-86c9-019fc8f13f08 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.127407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.128305 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.128678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.129092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.130264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.133874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.154365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1286/2563] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:49.156472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.172426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81e474-c52b-43c7-8305-fbf08e844e9e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.179467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.180162 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.180578 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.180858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.181656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.183489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.207722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1278/2564] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:49.217495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.245456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.248032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.276077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361207d-91f7-4baf-8a84-a7da61b26a46 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.281631 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f2a8-e4a1-4a3d-a717-623a9d54d6da admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.282495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.283487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.283899 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.284303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] PATH_INFO: `/v3/users/2cd2dceadb3542269cfe0b918dc1b761` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.285938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd2dceadb3542269cfe0b918dc1b761)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.288456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.296537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.298487 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.300509 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.304144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] PATH_INFO: `/v3/projects/bb5285b453b14a67aade249f7ce7eb71/users/d87e5b9caec84340b78f074a45b6c64f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.342394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5285b453b14a67aade249f7ce7eb71, user_id=d87e5b9caec84340b78f074a45b6c64f, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.347172 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.388965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1287/2565] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:49 2022] PUT /identity/v3/projects/bb5285b453b14a67aade249f7ce7eb71/users/d87e5b9caec84340b78f074a45b6c64f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:49.388965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.388965 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.395619 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd2dceadb3542269cfe0b918dc1b761'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.396331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd2dceadb3542269cfe0b918dc1b761'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.397323 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd2dceadb3542269cfe0b918dc1b761'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.418046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd2dceadb3542269cfe0b918dc1b761'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.429643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a2032da7-9a9d-493d-8151-1719c2add34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd2dceadb3542269cfe0b918dc1b761'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.461943 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1279/2566] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:49 2022] DELETE /identity/v3/users/2cd2dceadb3542269cfe0b918dc1b761 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:49.463833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81a1e-60ba-4b3e-afc8-f7a21641cc6d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.464107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81a1e-60ba-4b3e-afc8-f7a21641cc6d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.464554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81a1e-60ba-4b3e-afc8-f7a21641cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.501636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6bb81a1e-60ba-4b3e-afc8-f7a21641cc6d None None] MFA Rules not processed for user `d87e5b9caec84340b78f074a45b6c64f`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:49.503254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6bb81a1e-60ba-4b3e-afc8-f7a21641cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.549502 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e4431-6d12-4268-9547-28b62cd5c53f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.549756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:49.639384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:49.643434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1280/2567] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:49.650534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.652421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.654325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.703253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:49.706581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.708334 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.709667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.710559 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.712700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] PATH_INFO: `/v3/users/48d622b254f1464aba742a350f5bf20a` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.716216 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d622b254f1464aba742a350f5bf20a)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.723766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1281/2568] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:49.724308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.726554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.731298 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.844422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d622b254f1464aba742a350f5bf20a'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.845633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d622b254f1464aba742a350f5bf20a'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.848259 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d622b254f1464aba742a350f5bf20a'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.868317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b362f-713c-47a3-b34e-b3c2e4b95273 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:49.872772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d622b254f1464aba742a350f5bf20a'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.874500 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:49.875346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:49.876122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:49.876564 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:49.879774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.893020 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d622b254f1464aba742a350f5bf20a'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:49.900825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:49.904502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:49.916554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1282/2569] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:49.917821 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:49.919483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:49.950848 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1288/2570] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:49 2022] DELETE /identity/v3/users/48d622b254f1464aba742a350f5bf20a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:50.045853 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac5d4b-1880-4942-98de-d34beb8e2380 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:50.137587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:50.138641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.139091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.140123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.143680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:50.211953 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:50.279739 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:50.284621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075b244-a80f-41c0-84e6-80f99cc0f292 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:50.286759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:50.289106 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:50.325584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1283/2571] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:50.337298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586df94-bfa3-44d8-ac9f-8fcaf2b2136c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:50.358776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:50.359932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.360478 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.360973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] PATH_INFO: `/v3/projects/4470671f49b84b7aadeff6f5648bd5f7` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.362994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4470671f49b84b7aadeff6f5648bd5f7)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:50.368662 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:50.501389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4470671f49b84b7aadeff6f5648bd5f7', 'request_id': 'req-045e8c91-df0f-45b7-89a4-123e9a9f8504'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:50.515515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4470671f49b84b7aadeff6f5648bd5f7', 'request_id': 'req-045e8c91-df0f-45b7-89a4-123e9a9f8504'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:50.538313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4470671f49b84b7aadeff6f5648bd5f7', 'request_id': 'req-045e8c91-df0f-45b7-89a4-123e9a9f8504'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:50.606560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] The token cache is being invalidate because project 4470671f49b84b7aadeff6f5648bd5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:50.608084 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:50.611133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-045e8c91-df0f-45b7-89a4-123e9a9f8504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:50.618136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1289/2572] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:50 2022] DELETE /identity/v3/projects/4470671f49b84b7aadeff6f5648bd5f7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:50.626984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.626984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.627791 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.695979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:50.698232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:50.831112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1284/2573] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:50.844339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.845141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.845290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.898929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:50.902096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:50.902438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:50.904388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:50.928929 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1290/2574] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:50.934648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:50.936177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e2e16-b05e-41a5-88c8-e985321b920b None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:50.946681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:50.947685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b1bc9-7bb9-40a1-a170-a4183c6eea20 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:50.949057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.949940 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.950714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] PATH_INFO: `/v3/projects/2821c0ad67e74707b22c10120283b650` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.953657 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2821c0ad67e74707b22c10120283b650)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:50.953931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:50.956043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:50.956043 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:50.956342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:50.957479 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:50.959186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:50.961470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:50.969315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:50.995854 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1291/2575] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:51:51.012171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.055423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b67e07-7008-4b2c-b760-f941a2c91479 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.087824 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.088809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.089300 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.089938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.091025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.095661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.111399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2821c0ad67e74707b22c10120283b650', 'request_id': 'req-caf98bbd-d307-4821-9de1-6cf1a7d3762b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.128544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2821c0ad67e74707b22c10120283b650', 'request_id': 'req-caf98bbd-d307-4821-9de1-6cf1a7d3762b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.143501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2821c0ad67e74707b22c10120283b650', 'request_id': 'req-caf98bbd-d307-4821-9de1-6cf1a7d3762b'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.150902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1292/2576] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:51 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:51.156964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.171262 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.174296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] The token cache is being invalidate because project 2821c0ad67e74707b22c10120283b650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:51.175487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.176721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.185158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1285/2577] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:50 2022] DELETE /identity/v3/projects/2821c0ad67e74707b22c10120283b650 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:51.187447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.190049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:51.279762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44fc3-fa7e-47ee-8ce3-c3ce3670a9ab admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.291931 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.293386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.294018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.294728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.296435 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.299116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.345743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1293/2578] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:51 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:51.352271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.354477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:51.358816 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.378006 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d676d5c-0fa4-44ec-bc0f-3ac2b17c16ec admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.391544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.392364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.394142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.395739 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.396552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.401083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.405432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf98bbd-d307-4821-9de1-6cf1a7d3762b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.418793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.418793 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.419783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1294/2579] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:51.423761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.426912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.432987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] PATH_INFO: `/v3/users/1c8bf38d12d74afc855c1ef66a88c142` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.435608 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8bf38d12d74afc855c1ef66a88c142)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.437504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b45c7-91f6-4496-975a-8097ce54b188 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.438069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.444097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.445138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.445489 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.445826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.446545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.449107 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.461302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1295/2580] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:51.466171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.489623 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f66e-73b6-4491-ac5a-e1f480055a5a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.503470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.512771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.513439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.513916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] PATH_INFO: `/v3/projects/faa525b4004e41589111bb482b473d5b/users/6ce8be9b1beb465aa102093dbe23ee6f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.547473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8bf38d12d74afc855c1ef66a88c142'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.548847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8bf38d12d74afc855c1ef66a88c142'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.550036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8bf38d12d74afc855c1ef66a88c142'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.557075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa525b4004e41589111bb482b473d5b, user_id=6ce8be9b1beb465aa102093dbe23ee6f, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:51.561245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80270abd-f5c7-4adf-abdf-b697b5013c59 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:51.571975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8bf38d12d74afc855c1ef66a88c142'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.584703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8bf38d12d74afc855c1ef66a88c142'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:51.587024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1296/2581] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:51 2022] PUT /identity/v3/projects/faa525b4004e41589111bb482b473d5b/users/6ce8be9b1beb465aa102093dbe23ee6f/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:51.601389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.602116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.602789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.606833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1286/2582] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:51 2022] DELETE /identity/v3/users/1c8bf38d12d74afc855c1ef66a88c142 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:51.647641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] MFA Rules not processed for user `6ce8be9b1beb465aa102093dbe23ee6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:51.649321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:51.791173 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1297/2583] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:51.796296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:51.799854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:51.938257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41381227-6979-4118-9c29-2287bcf6cd9c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:51.978216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:51.978216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:51.978572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:51.978911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:51.995721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:52.001823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33719-9949-4f0b-bf01-becb50fb5024 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:52.038528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1287/2584] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:52.113730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:52.125862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:52.228221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:52.265544 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d04517-7f6c-4894-b815-96627730d0e1 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:52.271408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:52.272231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:52.272524 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:52.272802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] PATH_INFO: `/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:52.274039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2e36fd5a9746d6b451ccdf136aee6e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:52.276867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:52.351877 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2e36fd5a9746d6b451ccdf136aee6e', 'request_id': 'req-bf89bfd2-7388-4898-8b55-f76dd3b9032b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:52.364453 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2e36fd5a9746d6b451ccdf136aee6e', 'request_id': 'req-bf89bfd2-7388-4898-8b55-f76dd3b9032b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:52.377648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2e36fd5a9746d6b451ccdf136aee6e', 'request_id': 'req-bf89bfd2-7388-4898-8b55-f76dd3b9032b'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:52.395917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] The token cache is being invalidate because project 1b2e36fd5a9746d6b451ccdf136aee6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:52.396252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:52.396888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-bf89bfd2-7388-4898-8b55-f76dd3b9032b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:52.399393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1298/2585] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:52 2022] DELETE /identity/v3/projects/1b2e36fd5a9746d6b451ccdf136aee6e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:52.407861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:52.408772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:52.409266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:52.440596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:52.441881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:52.560125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:52.579569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1288/2586] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:52.588757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:52.589223 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:52.589742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:52.622429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:52.631713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:52.651732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1299/2587] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:52.656394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:52.684912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef654-77cb-46d1-a59d-899afbb6f070 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:52.696169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:52.697410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:52.698898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:52.699446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:52.700681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:52.701421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:52.705938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:52.735218 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1289/2588] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:52.742480 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:52.759827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729f128-a804-42cf-9ac6-350dc1b58541 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:52.778082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:52.779153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:52.779604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:52.780050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:52.785959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:52.796012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:52.889382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1300/2589] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:52.902124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:52.929766 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8eb2-b6cf-4d04-9bda-b373f0cff664 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.089300 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.090021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.090371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.090711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.091482 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.094057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:53.139191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1290/2590] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:52 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:53.140104 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:53.153579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9423dc-a36a-4946-a8a0-82d6a33275ed admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.160866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.161593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.162041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.162390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.163111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.164820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:53.180103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1301/2591] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:53.182760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:53.201781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b8fb8-f995-4c14-84ff-97e2863bb27e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.209016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.209877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.210422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.211533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.212581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.214585 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0de8a-90b3-404a-9991-3c03b8fa46f0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:53.236340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1291/2592] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:53.241210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:53.263119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e2fa8-c015-4152-8753-b928d915d88a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.272129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.273992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.275582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.276087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] PATH_INFO: `/v3/projects/e92b7c0f4f634828859862631f449aef/users/75e54040ca0945978105bfa798b1bdd1/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.304272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92b7c0f4f634828859862631f449aef, user_id=75e54040ca0945978105bfa798b1bdd1, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.314030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:53.337444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1302/2593] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:53 2022] PUT /identity/v3/projects/e92b7c0f4f634828859862631f449aef/users/75e54040ca0945978105bfa798b1bdd1/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:53.348483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.348984 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.349463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.420661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] MFA Rules not processed for user `75e54040ca0945978105bfa798b1bdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:53.422184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:53.578303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1292/2594] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:53.593092 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:53.596966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:53.680826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6ddd-85fd-4ef8-a02d-610bb05054bf admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.686446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.687143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.687491 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.687762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.702827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.704320 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3510974-60a3-4aaf-9e05-d6eaf3fdb435 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:53.727379 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1303/2595] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:53.738575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:53.852035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:53.870292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e2db9-bf5a-46ce-a88e-f770482833e9 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:53.879334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:53.880721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:53.881360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:53.881923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] PATH_INFO: `/v3/users/75e54040ca0945978105bfa798b1bdd1` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:53.884447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e54040ca0945978105bfa798b1bdd1)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:53.888356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:54.020076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e54040ca0945978105bfa798b1bdd1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:54.021303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e54040ca0945978105bfa798b1bdd1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:54.024726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e54040ca0945978105bfa798b1bdd1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:54.055605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e54040ca0945978105bfa798b1bdd1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:54.089421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e54040ca0945978105bfa798b1bdd1'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:54.145493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1293/2596] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:53 2022] DELETE /identity/v3/users/75e54040ca0945978105bfa798b1bdd1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:54.148748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:54.149652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:54.149652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:54.165726 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:54.198381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:54.199629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:54.335050 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1304/2597] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:54.351223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:54.353090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:54.521480 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a2b5a-4d79-48a3-bcf1-42fdaec92c15 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:54.522983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:54.523625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:54.524051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:54.524353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:54.539400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:54.541644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f0ae-c7fd-4ccc-9d18-67b8ffbac7d7 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:54.554271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1294/2598] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:54.978774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:54.979369 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.027990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4736ea-1228-4123-bee9-409f2eb15cc7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.036521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.038302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.039759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.040395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] PATH_INFO: `/v3/projects/e92b7c0f4f634828859862631f449aef` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.043115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92b7c0f4f634828859862631f449aef)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.048237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.188669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92b7c0f4f634828859862631f449aef', 'request_id': 'req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.203540 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92b7c0f4f634828859862631f449aef', 'request_id': 'req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.229944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92b7c0f4f634828859862631f449aef', 'request_id': 'req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.262108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] The token cache is being invalidate because project e92b7c0f4f634828859862631f449aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:55.262501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.264389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7a1ad044-dcb9-40f4-b7f4-5a95b7247067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.273810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1305/2599] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:54 2022] DELETE /identity/v3/projects/e92b7c0f4f634828859862631f449aef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:55.275365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8a76-1c2f-4b9f-bece-bce906688cc2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.276198 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8a76-1c2f-4b9f-bece-bce906688cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.276624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8a76-1c2f-4b9f-bece-bce906688cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.317879 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ae4f8a76-1c2f-4b9f-bece-bce906688cc2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:55.319363 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ae4f8a76-1c2f-4b9f-bece-bce906688cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.422854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1295/2600] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:55.433315 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.433943 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.434391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.480781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:55.486297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.506709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1306/2601] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:55.517791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.517977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.518219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.518770 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.546640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ec20b-38a5-452e-9282-1973862a0963 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.565938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.567381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.567867 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.568492 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.569488 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:55.570005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.572298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.576179 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] MFA Rules not processed for user `510b6f993c4c47c59c936e3493d63fec`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:55.578247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.586790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:55.589958 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1307/2602] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:55.591556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.594486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.618202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1717-186e-4a3a-83a1-68fb675b76e7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.624835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.625761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.626232 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.626673 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] PATH_INFO: `/v3/users/6ce8be9b1beb465aa102093dbe23ee6f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.628332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce8be9b1beb465aa102093dbe23ee6f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.631537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.708109 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1296/2603] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:55.709863 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.729317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce8be9b1beb465aa102093dbe23ee6f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.730251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce8be9b1beb465aa102093dbe23ee6f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.731023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce8be9b1beb465aa102093dbe23ee6f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.733049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9ca4-6067-46a6-99cd-d1b20e3e11b1 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.739991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.740803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.741123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.741399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.742039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.744790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.767441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:55.769802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce8be9b1beb465aa102093dbe23ee6f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.781370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1297/2604] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:55.785213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce8be9b1beb465aa102093dbe23ee6f'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:55.785367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.787120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.802287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1308/2605] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:55 2022] DELETE /identity/v3/users/6ce8be9b1beb465aa102093dbe23ee6f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:55.803163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.804728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:55.887518 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9b2a-00bb-4f7e-b5ff-916a1694bc23 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.891362 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3e35f-c5af-4001-96fe-d2b812ae3d25 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:55.893907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.894599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.894871 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.895165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.895870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.898055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693f024-be10-49db-ac83-a4ee788b9d76 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.898599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:55.899242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.899523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.899789 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.900438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:55.902867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:55.923916 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1309/2606] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:55.926936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:55.927600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:55.928024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:55.941019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1298/2607] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:55.942453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:55.962405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:55.963628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.015491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521b7d9-ca0a-4cb8-ba90-ce4c9a3370ed admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.023034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.023659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.023928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.024197 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.024850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.026549 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.040963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1299/2608] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:56.041168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1310/2609] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:56.041271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.044994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.051248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:56.055594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8724ee-7c8d-4ccc-a105-3f59b2b48e5e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.055888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d4d3-5125-40ae-ae94-ab28066340eb admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.063134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.063388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.063763 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.064041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.064307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.064426 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.064743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.064996 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.065280 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.066407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.067358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.069465 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.082122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1311/2610] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:56.082999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.087384 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.097935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1300/2611] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:56 2022] POST /identity/v3/users => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:56.099259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.109767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492a0b-36db-470c-89bf-08addcd774d1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.114938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.115566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.115844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.116116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] PATH_INFO: `/v3/projects/a71ed20a28394fa1bc0a2b4a1252590d/users/b2f852d63c7846fa8106135be1ad9b01/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.135664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71ed20a28394fa1bc0a2b4a1252590d, user_id=b2f852d63c7846fa8106135be1ad9b01, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.139043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.154464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1301/2612] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:56 2022] PUT /identity/v3/projects/a71ed20a28394fa1bc0a2b4a1252590d/users/b2f852d63c7846fa8106135be1ad9b01/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:56.155723 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.161653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914d2f5-f1c1-4c41-bd25-175c827bd69c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.176884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:56.236211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.237582 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.238038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.238310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.252478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d213c7-5f2a-41fd-a5e7-91b9f55f25dc admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.258516 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.259143 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.259417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.259683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.260335 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.261998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba140-2dc6-4070-af1d-487149e2a612 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.273581 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1302/2613] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:56.275875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.276760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.276760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.308976 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.310366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] MFA Rules not processed for user `b2f852d63c7846fa8106135be1ad9b01`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:56.310942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.311767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.326427 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1312/2614] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:56.327506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.339247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb29f24-2d63-4af8-bff7-c0e38e6f9502 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.346122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.347074 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.347412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.347753 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] PATH_INFO: `/v3/projects/480d858275c2420f9e3c87f660755ecc/users/894ec839b6ed49d195e035ab09d1fd6d/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.367842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d858275c2420f9e3c87f660755ecc, user_id=894ec839b6ed49d195e035ab09d1fd6d, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.370656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.392274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1313/2615] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:56 2022] PUT /identity/v3/projects/480d858275c2420f9e3c87f660755ecc/users/894ec839b6ed49d195e035ab09d1fd6d/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:56.396439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.428944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1303/2616] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:56.449489 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.451398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.519857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841faf-a3dc-49e2-9623-7ef6f6bbda54 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.527722 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.528670 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.529363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.529787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.531349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.534413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.548523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1314/2617] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:56.554238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.557615 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:56.566227 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd1195-0cf0-453d-947b-d3a02614031a None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.568363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c36d4-2203-4474-9479-53f0af7f0744 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.578973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.579678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.579957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.580738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] PATH_INFO: `/v3/projects/480d858275c2420f9e3c87f660755ecc/users/894ec839b6ed49d195e035ab09d1fd6d/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.582656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480d858275c2420f9e3c87f660755ecc, user_id=894ec839b6ed49d195e035ab09d1fd6d, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.586725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.609135 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1315/2618] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:56 2022] PUT /identity/v3/projects/480d858275c2420f9e3c87f660755ecc/users/894ec839b6ed49d195e035ab09d1fd6d/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:56.644026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.644854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.645261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.645628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.729319 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.731338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:56.746594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1304/2619] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:51:56.751386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.753998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.808790 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:56.811057 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:56.831118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21706-bf9a-42ed-953b-65174edbdeb7 service glance] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.843970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:56.919292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0c84-a151-4e1b-8d4f-b93bcb2da4e5 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:56.928794 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:56.929687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:56.930039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:56.930772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] PATH_INFO: `/v3/projects/faa525b4004e41589111bb482b473d5b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:56.932342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa525b4004e41589111bb482b473d5b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:56.938816 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.026135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.027091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.027557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.027856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] PATH_INFO: `/v3/users/d87e5b9caec84340b78f074a45b6c64f` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.029411 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87e5b9caec84340b78f074a45b6c64f)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.031856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.042412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa525b4004e41589111bb482b473d5b', 'request_id': 'req-7199df37-4651-44cc-8f33-9cc186be608d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.066306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa525b4004e41589111bb482b473d5b', 'request_id': 'req-7199df37-4651-44cc-8f33-9cc186be608d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.083023 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa525b4004e41589111bb482b473d5b', 'request_id': 'req-7199df37-4651-44cc-8f33-9cc186be608d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.117734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] The token cache is being invalidate because project faa525b4004e41589111bb482b473d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:57.118414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.119389 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7199df37-4651-44cc-8f33-9cc186be608d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.124946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1316/2620] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:56 2022] DELETE /identity/v3/projects/faa525b4004e41589111bb482b473d5b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:57.131411 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70901a8-9806-4355-a610-973a665bb0c1 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.131697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70901a8-9806-4355-a610-973a665bb0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.131971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70901a8-9806-4355-a610-973a665bb0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.134703 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87e5b9caec84340b78f074a45b6c64f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.136775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87e5b9caec84340b78f074a45b6c64f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.137505 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87e5b9caec84340b78f074a45b6c64f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.169678 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:57.174087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87e5b9caec84340b78f074a45b6c64f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.179168 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a70901a8-9806-4355-a610-973a665bb0c1 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:57.180515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a70901a8-9806-4355-a610-973a665bb0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:57.190146 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9e1b2f34-947f-448c-b75e-e9c3dfb2562a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87e5b9caec84340b78f074a45b6c64f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:57.215161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1305/2621] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:51:56 2022] DELETE /identity/v3/users/d87e5b9caec84340b78f074a45b6c64f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:57.217077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.217438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.217709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.268641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:57.269920 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:57.348508 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1317/2622] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:57.349830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.350114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.353117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.409767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:57.411057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:57.446329 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1306/2623] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:57.453674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:57.462355 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:57.517548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:57.545960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1318/2624] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:57.547002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:57.564765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51451d62-695b-435c-b8b9-d32576e96c38 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:57.581721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.582390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.582664 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.582938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.583640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:57.583941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.585716 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.606972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1319/2625] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:57.611537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:57.621187 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9681e-3c4c-415b-a2b0-4a3c363d31df None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:57.626641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.627340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.627673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.627979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.631131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d8c51-de11-4c1e-96b9-98804064e147 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:57.635945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.636570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.636853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.637158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.638398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.640136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.646175 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.647928 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.674682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1307/2626] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:51:57.677527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1320/2627] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:57 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:57.683856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:57.701031 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94690c-4577-406f-9dfe-7c6e77ec4d31 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:57.851356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.852284 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.852704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.853152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.853991 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.862033 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.917743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1308/2628] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:57 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:57.922224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:57.943562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b36d3-531c-4039-a94a-ab941b21857b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:57.954625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:57.956114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:57.957620 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:57.957987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:57.959757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:57.963288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:57.984295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1321/2629] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:57.992856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.008252 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea6988-2874-4e9b-8c8d-ba6f2178e94e admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.016427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.017396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.017735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.018071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.018810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.020611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a7f5-8c97-4255-b0a0-df08465d7d3a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.047563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:58.074977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1309/2630] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:58.078399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.106044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f158c-e659-4036-83a7-f3b45386d6c8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.117363 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.117642 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.117990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.119044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] PATH_INFO: `/v3/projects/8504b0734d0843c69b024602b64813e0/users/457bcd6eade54da1a10e4bf11807a675/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.166037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8504b0734d0843c69b024602b64813e0, user_id=457bcd6eade54da1a10e4bf11807a675, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.171937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.224696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1322/2631] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:58 2022] PUT /identity/v3/projects/8504b0734d0843c69b024602b64813e0/users/457bcd6eade54da1a10e4bf11807a675/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:58.236214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.237950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.238495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.333545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.336562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:58.357215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] MFA Rules not processed for user `457bcd6eade54da1a10e4bf11807a675`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:58.360792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:58.474897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1310/2632] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:58.482033 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8fc16-1763-481f-b729-ce3e8cb943ce admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.482664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.492844 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.493578 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.494005 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.494273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] PATH_INFO: `/v3/projects/bb5285b453b14a67aade249f7ce7eb71` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.495474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5285b453b14a67aade249f7ce7eb71)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.497704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.500214 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd49fb-d5a0-4415-ab39-098044064143 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.516673 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.517467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.517624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.517871 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.518524 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.522492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.579449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5285b453b14a67aade249f7ce7eb71', 'request_id': 'req-ba546208-d5ef-419c-a606-54598879ef3e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:58.595027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1311/2633] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:58.598714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5285b453b14a67aade249f7ce7eb71', 'request_id': 'req-ba546208-d5ef-419c-a606-54598879ef3e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:58.601219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.611049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5285b453b14a67aade249f7ce7eb71', 'request_id': 'req-ba546208-d5ef-419c-a606-54598879ef3e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:58.658350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] The token cache is being invalidate because project bb5285b453b14a67aade249f7ce7eb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:51:58.661650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:58.663558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-ba546208-d5ef-419c-a606-54598879ef3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:51:58.666685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1323/2634] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:51:58 2022] DELETE /identity/v3/projects/bb5285b453b14a67aade249f7ce7eb71 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:58.676678 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641207-028d-4a32-833c-cfcd98a36606 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.679506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641207-028d-4a32-833c-cfcd98a36606 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.679968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641207-028d-4a32-833c-cfcd98a36606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.732212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d0641207-028d-4a32-833c-cfcd98a36606 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:58.734376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d0641207-028d-4a32-833c-cfcd98a36606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:58.753959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:58.772782 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95e4a-8948-4c66-9150-d68207163076 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.789684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.791189 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.791810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.792401 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.793733 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.798313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.843955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1324/2635] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:58.845629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.845911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.846187 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.854277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1312/2636] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:58.864199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.868028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:58.886313 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:58.887333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:58.898825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093c544-8bd1-4caa-9b73-164ced9a5bd5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.899419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1325/2637] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:51:58.906298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.918112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.918677 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babe57a-5a93-43f3-88af-3c6ee133061c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.918848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.919026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.919297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.920338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.922325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.924864 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:58.925888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:58.926349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:58.926820 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:58.927671 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:51:58.928198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:58.931067 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:58.955911 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1326/2638] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:51:58.961793 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.967908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1313/2639] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:58.974813 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:58.982463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2784e-0893-487f-a872-10b888013702 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:58.999732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe439-8f29-42b5-ae39-fe08a085655d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.000368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.001057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.001340 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.001624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.002265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.005191 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.012554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.014398 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.015182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.015784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] PATH_INFO: `/v3/projects/412b8b311af54adc84286cff3464ba3b/users/461cfb0bd5654974806aa9aea6ebfea2/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.059885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412b8b311af54adc84286cff3464ba3b, user_id=461cfb0bd5654974806aa9aea6ebfea2, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.065720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.075633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1327/2640] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:58 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:51:59.081204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.101008 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1314/2641] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:58 2022] PUT /identity/v3/projects/412b8b311af54adc84286cff3464ba3b/users/461cfb0bd5654974806aa9aea6ebfea2/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:59.102773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.156483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:59.263581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5330-2ebf-42cf-9611-096365424967 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.275414 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.277070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.278026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.279182 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.279495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9de79-17fd-42b4-b1b6-6a13f478bf35 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.281603 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.285667 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.288051 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.289403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.290419 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.290621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.292163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.295435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.323002 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1315/2642] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:59.327804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.336774 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1328/2643] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:51:59 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:51:59.339301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f578b-eabe-48e3-a70c-421532a9fc1d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.341615 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.345930 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.346959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.347161 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.347343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] PATH_INFO: `/v3/projects/412b8b311af54adc84286cff3464ba3b/users/461cfb0bd5654974806aa9aea6ebfea2/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.351577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=412b8b311af54adc84286cff3464ba3b, user_id=461cfb0bd5654974806aa9aea6ebfea2, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.355684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631acbe-949b-4108-953a-3a11b800fd4f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.362912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3e8c-ce9f-4f27-9df6-0085a0293ae3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.368730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.369558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.370376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.370376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.370798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.372850 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.375584 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1316/2644] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:59 2022] PUT /identity/v3/projects/412b8b311af54adc84286cff3464ba3b/users/461cfb0bd5654974806aa9aea6ebfea2/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:51:59.388528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.389070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.389420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.414057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1329/2645] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:51:59.418527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.426014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] MFA Rules not processed for user `461cfb0bd5654974806aa9aea6ebfea2`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:59.427275 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:59.442112 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca52d2-e5e4-459f-9fed-2ac2448ac6b0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.530464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1317/2646] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:59.546840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.548606 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:59.567225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:59.584839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.585808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.586088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.586362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.587022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.588788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.612403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1330/2647] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:51:59.618700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:51:59.633553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f983d-2e33-48b8-ae72-0ad8866cb912 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.643200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.644161 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.644437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.644718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] PATH_INFO: `/v3/projects/a5a6ff024e48458b91855ce395c99816/users/1cc62abc6caf45cb8f41ea4c1af41387/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.665915 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a6ff024e48458b91855ce395c99816, user_id=1cc62abc6caf45cb8f41ea4c1af41387, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:51:59.668842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bb4da-b784-4013-977f-6bd0529b61fc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:51:59.695273 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1331/2648] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:51:59 2022] PUT /identity/v3/projects/a5a6ff024e48458b91855ce395c99816/users/1cc62abc6caf45cb8f41ea4c1af41387/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:51:59.698948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0be1-7953-4a93-9ce2-9273c5c72c1d None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:51:59.714055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.714362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.714592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.763022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] MFA Rules not processed for user `1cc62abc6caf45cb8f41ea4c1af41387`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:51:59.764328 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:51:59.796613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:59.810796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:51:59.811447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:51:59.811795 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:51:59.812084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:51:59.983503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1332/2649] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:51:59.989835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.001104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.002830 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.015670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1318/2650] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:00.220717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391da43-464b-4a4f-bb7e-5b1f11a8ef48 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:00.241224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:00.242762 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.243506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.243997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.245120 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.247756 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.353917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1333/2651] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:51:59 2022] POST /identity/v3/projects => generated 375 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:00.360100 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.382065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f5c9f-7a34-4641-9002-c9d5a0d08505 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:00.529684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:00.530353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.530633 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.531367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.531539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.533662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.592073 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1319/2652] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:00 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:00.594924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.626754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6acd-652e-45e7-b18d-85a6cf2b24ad admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:00.636403 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:00.637099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.637377 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.637648 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.638374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.640412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.669042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1334/2653] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:00.671552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.692237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961290-3837-48b5-b160-18e11863837c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:00.697391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:00.698118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.698461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.698798 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.699544 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.701352 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.726849 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1320/2654] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:00.738969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.752192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0544b-829f-4216-8cfd-9af3b2b77a55 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:00.758002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:00.759253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.759748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.760307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] PATH_INFO: `/v3/projects/1ada90343b96462cbc035eee84e03018/users/4f3207a98a2d4860bb93ffb4d3499896/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.797697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ada90343b96462cbc035eee84e03018, user_id=4f3207a98a2d4860bb93ffb4d3499896, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:00.800857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b1995-7168-4a7c-8d49-f60bf349ceb9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:00.812691 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:00.847536 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1335/2655] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:00 2022] PUT /identity/v3/projects/1ada90343b96462cbc035eee84e03018/users/4f3207a98a2d4860bb93ffb4d3499896/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:00.862364 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:00.862907 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:00.863282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:00.878159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:00.922746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] MFA Rules not processed for user `4f3207a98a2d4860bb93ffb4d3499896`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:00.923761 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:00.963090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a229b5e-6cd0-4d8c-8fe6-dc7217d4c60b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:01.027154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:01.153126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '461cfb0bd5654974806aa9aea6ebfea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412b8b311af54adc84286cff3464ba3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:01.153126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:01.153126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:01.153711 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:01.153957 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:01.156240 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:01.157894 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:01.158593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1336/2656] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:01.163755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:01.184403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1321/2657] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:52:01.186333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:01.214773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5c2fc-4594-48d0-a1f7-0b8c3d21d963 tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:01.225010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '461cfb0bd5654974806aa9aea6ebfea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412b8b311af54adc84286cff3464ba3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:01.225010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:01.225010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:01.226561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:01.226561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:01.238361 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:01.359656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1322/2658] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:01 2022] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:01.363829 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:01.411571 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21cd3-5cea-46f8-af9e-c68d3e2d866c None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:01.682003 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:01.683772 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:01.684308 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:01.686922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:01.688639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:01.698119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:01.749634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5c8ac-548b-40aa-ac6f-dddc908be5dc tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:01.764226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '461cfb0bd5654974806aa9aea6ebfea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412b8b311af54adc84286cff3464ba3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:01.765534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:01.766007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:01.766458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:01.767314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:01.767788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:01.774458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:01.785594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1337/2659] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:01 2022] POST /identity/v3/projects => generated 377 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:01.786822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:01.811157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1323/2660] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:01.872841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:01.876773 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:01.907857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ad45c-68c7-43bc-9be9-324c9375cdad tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.005628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c35a2-993d-489e-9581-9b9092fd9c73 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.023434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.026222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.026689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.027167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.029470 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.033362 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:02.104993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1338/2661] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:01 2022] POST /identity/v3/users => generated 295 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:02.116309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:02.129074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '461cfb0bd5654974806aa9aea6ebfea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412b8b311af54adc84286cff3464ba3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.130456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.130892 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.131353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] PATH_INFO: `/v3/projects/a754f125ec604c9590599a9ffbc81253` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.134779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a754f125ec604c9590599a9ffbc81253)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.144776 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:02.155103 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6ce2b-bd09-42db-974d-4a5353f0df50 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.173396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.174937 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.175395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.175906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.177394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.179539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:02.195383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1339/2662] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:02.200445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:02.213260 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8f75f-272f-466e-b59c-8c3ce2460340 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.229462 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.255039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.255428 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.256493 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] PATH_INFO: `/v3/projects/aa3463937b754e6984022173be367059/users/21b0529ae1b34854acb5d9bad40c3e9e/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.272566 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:02.310818 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3463937b754e6984022173be367059, user_id=21b0529ae1b34854acb5d9bad40c3e9e, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.311833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a754f125ec604c9590599a9ffbc81253', 'request_id': 'req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:02.323494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:02.346503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a754f125ec604c9590599a9ffbc81253', 'request_id': 'req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:02.350160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1340/2663] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:02 2022] PUT /identity/v3/projects/aa3463937b754e6984022173be367059/users/21b0529ae1b34854acb5d9bad40c3e9e/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:02.354696 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:02.372258 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a754f125ec604c9590599a9ffbc81253', 'request_id': 'req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:02.414924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] The token cache is being invalidate because project a754f125ec604c9590599a9ffbc81253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:02.415233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:02.416364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:02.423605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1324/2664] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:01 2022] DELETE /identity/v3/projects/a754f125ec604c9590599a9ffbc81253 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:02.563892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faa98-564e-4d19-9060-4f12de4b84c8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.571579 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.572227 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.576016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.577146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.583672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.587779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:02.637434 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:02.641547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:02.643163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1341/2665] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:02.961267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71ab47-b3f7-4aba-8b8c-8d710f63210d tempest-VolumeQuotaClassesTest-822237113 tempest-VolumeQuotaClassesTest-822237113-project-admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:02.989090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:02.990201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:02.990595 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:02.991394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] PATH_INFO: `/v3/projects/aa3463937b754e6984022173be367059/users/21b0529ae1b34854acb5d9bad40c3e9e/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:02.995092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3463937b754e6984022173be367059, user_id=21b0529ae1b34854acb5d9bad40c3e9e, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:02.999994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e5660-8995-4091-ae0b-e4e8d4140dc3 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:03.026371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:03.030991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.035542 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1325/2666] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:02 2022] PUT /identity/v3/projects/aa3463937b754e6984022173be367059/users/21b0529ae1b34854acb5d9bad40c3e9e/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:03.076012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848387-efb5-453f-b6b1-76724602118c admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:03.160237 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:03.160548 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:03.161331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:03.261846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] MFA Rules not processed for user `21b0529ae1b34854acb5d9bad40c3e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:03.266722 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.330141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:03.330905 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:03.331233 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:03.331418 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] PATH_INFO: `/v3/users/457bcd6eade54da1a10e4bf11807a675` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:03.336053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457bcd6eade54da1a10e4bf11807a675)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:03.336053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:03.382314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:03.427800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1326/2667] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:03.448929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:03.453890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.479228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457bcd6eade54da1a10e4bf11807a675'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:03.482026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457bcd6eade54da1a10e4bf11807a675'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:03.483961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457bcd6eade54da1a10e4bf11807a675'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:03.517052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457bcd6eade54da1a10e4bf11807a675'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:03.555996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-94fcb017-a635-48c9-97b0-8ede03f83246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457bcd6eade54da1a10e4bf11807a675'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:03.563368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:03.612412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f12652-103f-43af-b7fd-d5b389fbb3a3 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:03.616190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1342/2668] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:03 2022] DELETE /identity/v3/users/457bcd6eade54da1a10e4bf11807a675 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:03.624975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:03.624975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:03.624975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:03.672419 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:03.673713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.755807 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:03.756465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:03.756959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:03.757241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:03.761289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.851366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1343/2669] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:03.865504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:03.867199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:03.933317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:03.936188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:03.960464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1327/2670] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:03.987641 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cddd6-0fb9-48c3-9887-3066ff5865df None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:03.995510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:03.996681 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:03.997310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:03.997898 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:04.022309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:04.025702 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea0d2f-ee09-431b-b10a-3b5ccf70f97e service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:04.047213 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1344/2671] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:04.779483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:04.782255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:04.832420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbc24d-0d42-4adf-820f-7ad009062cea service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:04.845565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:04.846915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:04.847400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:04.847701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] PATH_INFO: `/v3/projects/8504b0734d0843c69b024602b64813e0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:04.849014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8504b0734d0843c69b024602b64813e0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:04.850946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:04.982535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8504b0734d0843c69b024602b64813e0', 'request_id': 'req-e6d829fb-1d24-4ece-b42c-929b6043149c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.024243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8504b0734d0843c69b024602b64813e0', 'request_id': 'req-e6d829fb-1d24-4ece-b42c-929b6043149c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.033510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8504b0734d0843c69b024602b64813e0', 'request_id': 'req-e6d829fb-1d24-4ece-b42c-929b6043149c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.051742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] The token cache is being invalidate because project 8504b0734d0843c69b024602b64813e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:05.052169 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.054803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.064010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:05.064580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1328/2672] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:04 2022] DELETE /identity/v3/projects/8504b0734d0843c69b024602b64813e0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:05.064675 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:05.066366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:05.070067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:05.072018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.112652 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] MFA Rules not processed for user `894ec839b6ed49d195e035ab09d1fd6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:05.114296 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.131318 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:05.163279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:05.186947 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d829fb-1d24-4ece-b42c-929b6043149c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:05.193421 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:05.194223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:05.194567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:05.195979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] PATH_INFO: `/v3/users/461cfb0bd5654974806aa9aea6ebfea2` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:05.197432 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461cfb0bd5654974806aa9aea6ebfea2)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:05.199806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:05.257342 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1345/2673] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:05.271381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:05.273283 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.281749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461cfb0bd5654974806aa9aea6ebfea2'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.282377 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461cfb0bd5654974806aa9aea6ebfea2'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.283013 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461cfb0bd5654974806aa9aea6ebfea2'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.314138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461cfb0bd5654974806aa9aea6ebfea2'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.324039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461cfb0bd5654974806aa9aea6ebfea2'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.343605 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1329/2674] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:05 2022] DELETE /identity/v3/users/461cfb0bd5654974806aa9aea6ebfea2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:05.371464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4eae0-188e-4cfd-aea3-c175ed927f96 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:05.442460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '284f6ac815d940ccb5f3dc7755bc201e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:05.443140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:05.443481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:05.443815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:05.446271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.555584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:05.557445 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269e469-8ad5-420c-9d68-c106357708f8 service glance] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:05.574096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1346/2675] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:05.736108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:05.738326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.853892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:05.854199 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:05.854537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:05.892754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec63481-84ea-4cc8-8a88-8c0a5deaa873 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:05.898622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:05.899537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:05.900074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:05.900511 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] PATH_INFO: `/v3/projects/412b8b311af54adc84286cff3464ba3b` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:05.902486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=412b8b311af54adc84286cff3464ba3b)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:05.905596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:05.917777 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:05.919804 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:05.975656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:05.987074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412b8b311af54adc84286cff3464ba3b', 'request_id': 'req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:05.995152 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:06.005163 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412b8b311af54adc84286cff3464ba3b', 'request_id': 'req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:06.017440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1347/2676] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:06.018669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412b8b311af54adc84286cff3464ba3b', 'request_id': 'req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:06.018901 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.020715 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.034043 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] The token cache is being invalidate because project 412b8b311af54adc84286cff3464ba3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:06.034375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:06.035141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-5ddd350f-8ec4-468e-842b-ae9d4f4b9b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:06.041760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1330/2677] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:05 2022] DELETE /identity/v3/projects/412b8b311af54adc84286cff3464ba3b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:06.044697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.045028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.045616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.074667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:06.077095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.105148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab671-8a7b-478e-8340-d05eeb4d347a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.163368 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.165764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1331/2678] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:06.165764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.169214 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.169986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.170421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.172306 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.172687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.253417 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.255879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34eac7-f355-408f-98d8-1baa76b27bc5 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.272256 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1348/2679] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:06.273700 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.274054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.274394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.283397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874c969-a590-4f55-b402-78fad45ba60c None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.299912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.301029 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.301215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.301431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.304301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:06.305994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.307163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:06.333633 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1349/2680] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:06.337017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.356432 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926934f2-2a07-46a5-9379-8188e161ff1a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.362444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.365747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.366025 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.366321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.372264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:06.372505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.374349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.402018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1350/2681] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:06.404858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.419814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334b67-8d41-462e-9dea-45c4c83ca6f5 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.431856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.436970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.436970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.436970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.436970 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.453185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.460425 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.463280 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.486150 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1332/2682] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:52:06.500483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1351/2683] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:06 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:06.501997 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.537291 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dc886-3fc1-405e-af79-ff01cd23fb2e service swift] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.600181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:06.691547 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.692181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.692456 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.695302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.696463 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.699264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.745196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1333/2684] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:06 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:06.749996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.780993 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767d674-9721-41e8-933f-d7f331a4ebc8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.798713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.798972 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.799251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.799575 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.800243 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.802083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.804882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:06.824688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1352/2685] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:06.828677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.843211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42e40e-ed7a-4c9f-a8f5-0dfa2c268822 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.860560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.861326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.861823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.862357 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.863297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.865253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb505e2-89fd-4dd5-8a2e-1aef0a0afacd admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.878976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1334/2686] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:06.884011 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:06.909338 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6fd86-6289-4986-9f2f-983815c7455b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:06.930714 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:06.931545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:06.931718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:06.931986 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] PATH_INFO: `/v3/projects/7c480bcc51404fd080d47e85d4bec718/users/9c7bbc7f5db04589806eb842d39d36c5/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:06.958045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c480bcc51404fd080d47e85d4bec718, user_id=9c7bbc7f5db04589806eb842d39d36c5, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:06.960416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:06.999889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1353/2687] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:06 2022] PUT /identity/v3/projects/7c480bcc51404fd080d47e85d4bec718/users/9c7bbc7f5db04589806eb842d39d36c5/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:07.011519 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.012181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.012181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.047266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] MFA Rules not processed for user `9c7bbc7f5db04589806eb842d39d36c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:07.048660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:07.157961 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1335/2688] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:07.162110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.315110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46ab4-b5de-4322-bd7c-7685ece08e8a admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.324152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.325049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.326386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.326932 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.327748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.330660 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.388471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.401133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1354/2689] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:07 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:07.404417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07da9f-6acb-42d9-9db7-27fe899e6ee4 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.516142 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.519000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:07.571840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.572445 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.572709 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.573011 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.573656 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.576190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.610699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1336/2690] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:07 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:07.615942 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.618609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f88e-c818-4f92-b312-b481e2c37cc6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.630624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6d0b-97b6-4617-859d-805dd39ed8c1 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.631689 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.632537 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.633129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.633394 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.636355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:07.645405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.646104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.646545 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.646941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.647669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.649858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.667495 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1337/2691] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:07.669396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.683350 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e7c79-fa59-4b98-8c9f-b6539a583a0d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.691027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.692386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.692689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.693255 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.694684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.696475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.699743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:07.716745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1338/2692] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:07.717752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:07.740848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce3d1e-1e9f-46bc-9048-8c580ae7c2e6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:07.752144 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:07.753671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.754407 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.755098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] PATH_INFO: `/v3/projects/773adebdd066403b8db112003e52519c/users/b78c176d8e74419abfe95f7a82419c33/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.793947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.794514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773adebdd066403b8db112003e52519c, user_id=b78c176d8e74419abfe95f7a82419c33, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:07.796269 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49a7c1-f957-42b2-ab3c-d50d2641d379 service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.800614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:07.813771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1355/2693] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:07.877810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1339/2694] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:07 2022] PUT /identity/v3/projects/773adebdd066403b8db112003e52519c/users/b78c176d8e74419abfe95f7a82419c33/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:07.882457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:07.882928 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:07.883405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:07.913017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:07.931723 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] MFA Rules not processed for user `b78c176d8e74419abfe95f7a82419c33`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:07.935013 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:08.090007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1356/2695] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:08.095737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.182987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf48e7-062f-41b9-a37b-9f054d9ebc38 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.190483 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.191900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.192332 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.192701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.193475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.197136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.240475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1340/2696] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:08 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:08.244763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.270088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d3ae6-0db1-43f8-bbd7-f907a8ee00c7 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.386152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.386840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.387116 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.387386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.388109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.390843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.500946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1357/2697] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:08 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:08.504936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.525022 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273413d-a222-4f3a-8b7c-27f15fb41672 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.547479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.549641 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.550180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.550358 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.551139 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.553834 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.577597 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1341/2698] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:08.581687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.592018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032aa12e-3771-4cfc-958e-4354f0774cfc admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.605975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.608550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.610341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.611045 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] PATH_INFO: `/v3/projects/49904024a74d442ab1585ed8436021ce/users/e88de9f456a74685b2e3c32036815649/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.634234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49904024a74d442ab1585ed8436021ce, user_id=e88de9f456a74685b2e3c32036815649, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.640786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.662960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1358/2699] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:08 2022] PUT /identity/v3/projects/49904024a74d442ab1585ed8436021ce/users/e88de9f456a74685b2e3c32036815649/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:08.666784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.683457 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27a51-ea90-4250-92b6-ad68eea90100 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.785556 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.790476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.790891 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.791313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.792182 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.815437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f1440-2acc-430e-b170-81b48083c5fe admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.838533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1342/2700] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:08.842961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:08.854897 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f0f8b-6c5c-4363-a258-7812754d2157 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:08.861598 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:08.862902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.863204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.863832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] PATH_INFO: `/v3/projects/49904024a74d442ab1585ed8436021ce/users/e88de9f456a74685b2e3c32036815649/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.866288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49904024a74d442ab1585ed8436021ce, user_id=e88de9f456a74685b2e3c32036815649, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:08.869072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:08.906333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1359/2701] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:08 2022] PUT /identity/v3/projects/49904024a74d442ab1585ed8436021ce/users/e88de9f456a74685b2e3c32036815649/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:08.907814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:08.908128 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:08.908388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:08.945685 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] MFA Rules not processed for user `e88de9f456a74685b2e3c32036815649`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:08.947904 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:08.992134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:09.045041 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1343/2702] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:09.059189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:09.061452 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:09.167301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2beacf6-dea9-4831-9f61-a96ecb2f8b8d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:09.172823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:09.173531 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:09.173787 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:09.174078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:09.185922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:09.190697 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:09.193000 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:09.209042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1360/2703] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:09.401794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:09.418313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25484-cbfe-4b3f-9cd9-fe45abd280f2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:09.428238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d76880-c393-4835-af72-781190e9391f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:09.429065 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76880-c393-4835-af72-781190e9391f service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:09.429344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76880-c393-4835-af72-781190e9391f service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:09.429659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d76880-c393-4835-af72-781190e9391f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:09.588277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d76880-c393-4835-af72-781190e9391f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:09.589843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d76880-c393-4835-af72-781190e9391f service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:09.615262 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1344/2704] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:12.387366 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:12.389026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:12.473856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d0f94-df82-4100-931d-4b6458dbb14a service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:12.478960 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:12.479638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:12.479900 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:12.480198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] PATH_INFO: `/v3/users/1cc62abc6caf45cb8f41ea4c1af41387` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:12.481391 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc62abc6caf45cb8f41ea4c1af41387)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:12.483450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:12.555606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc62abc6caf45cb8f41ea4c1af41387'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:12.556393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc62abc6caf45cb8f41ea4c1af41387'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:12.557105 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc62abc6caf45cb8f41ea4c1af41387'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:12.576656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc62abc6caf45cb8f41ea4c1af41387'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:12.586902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc62abc6caf45cb8f41ea4c1af41387'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:12.605212 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1361/2705] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:12 2022] DELETE /identity/v3/users/1cc62abc6caf45cb8f41ea4c1af41387 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:12.610433 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:12.611351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:12.611351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:12.637026 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:12.638726 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:12.717447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1345/2706] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:12.735407 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:12.738151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:12.822814 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba1d61-637c-4b84-8747-e3ea4ba96fa2 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:12.829978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:12.829978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:12.831852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:12.831852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:12.845742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:12.847684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:12.862382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1362/2707] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:13.103308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:13.105025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.124070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc278ff-3e77-4644-8031-846049eb3b58 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:13.137769 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:13.138674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:13.139120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:13.139893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] PATH_INFO: `/v3/users/9c7bbc7f5db04589806eb842d39d36c5` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:13.144314 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7bbc7f5db04589806eb842d39d36c5)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:13.147250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:13.262188 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7bbc7f5db04589806eb842d39d36c5'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.263471 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7bbc7f5db04589806eb842d39d36c5'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.267858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7bbc7f5db04589806eb842d39d36c5'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.291577 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:13.293546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7bbc7f5db04589806eb842d39d36c5'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.310348 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5861136-ed24-4845-88c3-93d0c09ec79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7bbc7f5db04589806eb842d39d36c5'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.354602 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1346/2708] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:13 2022] DELETE /identity/v3/users/9c7bbc7f5db04589806eb842d39d36c5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:13.358654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:13.360552 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:13.360835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:13.361133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:13.365360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.404639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:13.405978 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.406138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d044-3aa7-4b36-9146-a9423f2366ba service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:13.445721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:13.533232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1347/2709] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:13.535115 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:13.535836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:13.536114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:13.536388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] PATH_INFO: `/v3/projects/a5a6ff024e48458b91855ce395c99816` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:13.540797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a6ff024e48458b91855ce395c99816)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:13.542992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:13.547530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:13.551226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.640329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a6ff024e48458b91855ce395c99816', 'request_id': 'req-185d3c09-1c28-4e90-855c-1058497b26c3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.668533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb2a59-d73c-40fb-8854-4e433d87c150 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:13.671069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a6ff024e48458b91855ce395c99816', 'request_id': 'req-185d3c09-1c28-4e90-855c-1058497b26c3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.679317 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a6ff024e48458b91855ce395c99816', 'request_id': 'req-185d3c09-1c28-4e90-855c-1058497b26c3'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.693070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] The token cache is being invalidate because project a5a6ff024e48458b91855ce395c99816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:13.693951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.695390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.700444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1363/2710] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:13 2022] DELETE /identity/v3/projects/a5a6ff024e48458b91855ce395c99816 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:13.701395 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:13.703287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.759219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:13.759914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:13.760259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:13.760534 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:13.764948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:13.796348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3c09-1c28-4e90-855c-1058497b26c3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:13.801686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:13.802572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:13.803021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:13.803472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] PATH_INFO: `/v3/users/4f3207a98a2d4860bb93ffb4d3499896` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:13.805068 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3207a98a2d4860bb93ffb4d3499896)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:13.807054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:13.835417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:13.860708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:13.863213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:13.942107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1348/2711] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:13.952728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3207a98a2d4860bb93ffb4d3499896'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.952728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3207a98a2d4860bb93ffb4d3499896'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.952728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3207a98a2d4860bb93ffb4d3499896'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.952728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:13.978355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3207a98a2d4860bb93ffb4d3499896'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:13.991238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3207a98a2d4860bb93ffb4d3499896'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.017909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1364/2712] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:13 2022] DELETE /identity/v3/users/4f3207a98a2d4860bb93ffb4d3499896 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:14.425156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:14.427681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:14.445067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08c51-e351-434c-b2b8-9d3bd91907da service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:14.557914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:14.560619 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:14.586805 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:14.588912 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:14.589823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:14.590211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] PATH_INFO: `/v3/projects/7c480bcc51404fd080d47e85d4bec718` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:14.593728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c480bcc51404fd080d47e85d4bec718)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:14.599396 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:14.688537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c480bcc51404fd080d47e85d4bec718', 'request_id': 'req-28f2cfb1-2d90-479d-a5aa-f094d633be2f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.698356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c480bcc51404fd080d47e85d4bec718', 'request_id': 'req-28f2cfb1-2d90-479d-a5aa-f094d633be2f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.707498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c480bcc51404fd080d47e85d4bec718', 'request_id': 'req-28f2cfb1-2d90-479d-a5aa-f094d633be2f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.718096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8be1d-784b-46cd-a30a-01adf534327f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:14.722133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] The token cache is being invalidate because project 7c480bcc51404fd080d47e85d4bec718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:14.722541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.723392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.729039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1349/2713] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:14 2022] DELETE /identity/v3/projects/7c480bcc51404fd080d47e85d4bec718 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:14.730003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:14.731681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:14.799613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:14.800482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:14.801059 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:14.801444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] PATH_INFO: `/v3/projects/1ada90343b96462cbc035eee84e03018` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:14.802841 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ada90343b96462cbc035eee84e03018)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:14.804975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:14.826609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2cfb1-2d90-479d-a5aa-f094d633be2f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:14.832687 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:14.834016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:14.834485 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:14.834758 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] PATH_INFO: `/v3/users/b78c176d8e74419abfe95f7a82419c33` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:14.837151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78c176d8e74419abfe95f7a82419c33)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:14.839540 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:14.865302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ada90343b96462cbc035eee84e03018', 'request_id': 'req-90c14d53-a886-4175-95b3-1fb4289a9488'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.887412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ada90343b96462cbc035eee84e03018', 'request_id': 'req-90c14d53-a886-4175-95b3-1fb4289a9488'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.897567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:14.901676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ada90343b96462cbc035eee84e03018', 'request_id': 'req-90c14d53-a886-4175-95b3-1fb4289a9488'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.927121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] The token cache is being invalidate because project 1ada90343b96462cbc035eee84e03018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:14.927121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.927653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.932964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1365/2714] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:14 2022] DELETE /identity/v3/projects/1ada90343b96462cbc035eee84e03018 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:14.935382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:14.937744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:14.946968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78c176d8e74419abfe95f7a82419c33'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.949140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:14.950772 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78c176d8e74419abfe95f7a82419c33'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.952062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78c176d8e74419abfe95f7a82419c33'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.974379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78c176d8e74419abfe95f7a82419c33'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:14.985967 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78c176d8e74419abfe95f7a82419c33'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.009233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1350/2715] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:14 2022] DELETE /identity/v3/users/b78c176d8e74419abfe95f7a82419c33 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:15.110228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c14d53-a886-4175-95b3-1fb4289a9488 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:15.221842 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:15.222511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:15.222789 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:15.223064 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] PATH_INFO: `/v3/users/21b0529ae1b34854acb5d9bad40c3e9e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:15.224255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b0529ae1b34854acb5d9bad40c3e9e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:15.226355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:15.336361 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b0529ae1b34854acb5d9bad40c3e9e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.341109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b0529ae1b34854acb5d9bad40c3e9e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.341989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b0529ae1b34854acb5d9bad40c3e9e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.378750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b0529ae1b34854acb5d9bad40c3e9e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.397504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b0529ae1b34854acb5d9bad40c3e9e'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.427049 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1366/2716] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:14 2022] DELETE /identity/v3/users/21b0529ae1b34854acb5d9bad40c3e9e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:15.454901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:15.456634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:15.483567 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae55f-c932-429b-b6db-0c77871c7ba6 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:15.588802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:15.590157 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:15.590908 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:15.591785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] PATH_INFO: `/v3/projects/773adebdd066403b8db112003e52519c` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:15.594525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=773adebdd066403b8db112003e52519c)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:15.601767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:15.704426 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773adebdd066403b8db112003e52519c', 'request_id': 'req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.721009 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773adebdd066403b8db112003e52519c', 'request_id': 'req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.731635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773adebdd066403b8db112003e52519c', 'request_id': 'req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.751353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] The token cache is being invalidate because project 773adebdd066403b8db112003e52519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:15.751645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.752356 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:15.754708 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1351/2717] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:15 2022] DELETE /identity/v3/projects/773adebdd066403b8db112003e52519c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:15.759147 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:15.761332 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:15.779088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac81939-8312-43ab-8402-9ae62715fa35 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:15.821679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:15.851976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:15.854019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:15.910991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:15.912063 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:15.912556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:15.913082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] PATH_INFO: `/v3/users/e88de9f456a74685b2e3c32036815649` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:15.913720 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:15.916052 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88de9f456a74685b2e3c32036815649)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:15.919178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:15.980532 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd86f6-7214-44cf-b7ce-ea41d0657e6d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:15.988699 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:15.989809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:15.990097 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:15.990369 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] PATH_INFO: `/v3/projects/aa3463937b754e6984022173be367059` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:15.992370 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3463937b754e6984022173be367059)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:15.994857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.008310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88de9f456a74685b2e3c32036815649'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.009202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88de9f456a74685b2e3c32036815649'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.009909 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88de9f456a74685b2e3c32036815649'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.033896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88de9f456a74685b2e3c32036815649'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.046545 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-28e64fcd-53d7-4e17-9d19-804b18c77164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88de9f456a74685b2e3c32036815649'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.075058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1367/2718] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:15 2022] DELETE /identity/v3/users/e88de9f456a74685b2e3c32036815649 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:16.099921 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3463937b754e6984022173be367059', 'request_id': 'req-70459356-a95a-485b-b9da-493b16b328ec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.113704 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3463937b754e6984022173be367059', 'request_id': 'req-70459356-a95a-485b-b9da-493b16b328ec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.130931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3463937b754e6984022173be367059', 'request_id': 'req-70459356-a95a-485b-b9da-493b16b328ec'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.156211 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] The token cache is being invalidate because project aa3463937b754e6984022173be367059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:16.156674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.162570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-70459356-a95a-485b-b9da-493b16b328ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.174460 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.174718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1352/2719] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:15 2022] DELETE /identity/v3/projects/aa3463937b754e6984022173be367059 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:16.174846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.174846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.203271 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:16.204163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.331044 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1368/2720] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:16.339185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.339464 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.339735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.379256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:16.381256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.395347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1353/2721] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:16.401878 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.419096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45f442-1a2a-4fb9-8a11-a548a15dbf1a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.426237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.427039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.427440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.427815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.428853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:16.429303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.431565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.454410 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1369/2722] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:16.460654 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.475563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56fad-011e-4767-af46-7e64eed4bc03 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.493205 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.498257 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.498784 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.499612 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.500062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.500721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.502550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.504843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.552839 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd837fb1-e927-40e7-b84d-eef479de3983 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.557256 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1354/2723] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:16.562580 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.576152 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.577211 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.577654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.578252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] PATH_INFO: `/v3/projects/49904024a74d442ab1585ed8436021ce` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.579838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=49904024a74d442ab1585ed8436021ce)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.582026 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.671333 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:16.682223 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5c38e-5151-4952-b086-5d842423b2a4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.716138 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49904024a74d442ab1585ed8436021ce', 'request_id': 'req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.732014 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49904024a74d442ab1585ed8436021ce', 'request_id': 'req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.755676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49904024a74d442ab1585ed8436021ce', 'request_id': 'req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.765959 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:16.778606 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] The token cache is being invalidate because project 49904024a74d442ab1585ed8436021ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:16.779200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.780302 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-a153e41d-360f-4f0f-b5b7-cca24b2e67ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:16.787624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1370/2724] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:16 2022] DELETE /identity/v3/projects/49904024a74d442ab1585ed8436021ce => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:16.793390 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.793674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.794110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.813809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.814573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.814764 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.815025 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.815667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.817803 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83b1fe-f435-44fb-abb5-4196420aeced admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.832797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:16.834295 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.848780 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1371/2725] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:16.855888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1355/2726] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:16.856676 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.859992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.861084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.861230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.861697 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.887101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b480e8-d50a-4943-b7d2-13b719397cb4 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.891138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:16.892596 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:16.904915 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1356/2727] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:16.908349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.909117 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.910167 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.910494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.910753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.911413 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.913567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.924647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb347e8-e5bc-4fad-9777-614ad68c0e04 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.931892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1372/2728] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:16.932691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.935983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.936858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.937221 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.937649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.938353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:16.938652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.940815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.945944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c302b-1b5b-4887-9ae7-5f21a008d451 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.955827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.955827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.957375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.957375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.959483 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.961998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:16.966076 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1357/2729] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:16.970721 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.986688 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462c640-82fe-4a68-989a-b7041685b05f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:16.993609 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:16.994365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:16.994986 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:16.995153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1373/2730] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:16.995392 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:16.996070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:16.996238 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:16.998446 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.006800 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01067304-6e1a-4e4e-9a98-e6d569a00db8 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.014209 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.016071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.016346 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.016611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] PATH_INFO: `/v3/projects/6920439fe6354c0ebd27fa73ab2f4b3b/users/2dea9bc1282e4adfbf268d7481fc9a33/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.037638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6920439fe6354c0ebd27fa73ab2f4b3b, user_id=2dea9bc1282e4adfbf268d7481fc9a33, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.040952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd411-cd13-4dde-999b-56c746c9533b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.047466 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1358/2731] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:16 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:17.054491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.069450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1374/2732] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:16 2022] PUT /identity/v3/projects/6920439fe6354c0ebd27fa73ab2f4b3b/users/2dea9bc1282e4adfbf268d7481fc9a33/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:17.081925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a776-2d30-496b-b787-4a736e193440 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.085370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a776-2d30-496b-b787-4a736e193440 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.086034 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848a776-2d30-496b-b787-4a736e193440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.125522 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e848a776-2d30-496b-b787-4a736e193440 None None] MFA Rules not processed for user `2dea9bc1282e4adfbf268d7481fc9a33`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:17.129225 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e848a776-2d30-496b-b787-4a736e193440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:17.156491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9010ab-9fea-4ef5-b1fb-a7cb345ebff5 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.248430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1375/2733] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:17.250561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848a776-2d30-496b-b787-4a736e193440 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.254491 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.255130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.255402 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.255670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.256344 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.258655 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.265293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848a776-2d30-496b-b787-4a736e193440 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.272560 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.273899 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.275975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.275975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.275975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.278838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.298826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1359/2734] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:17.300364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.324947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1376/2735] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:17.325988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710416c-4213-4d0f-9687-fe9e4ef357c3 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.327825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.351797 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:17.379169 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:17.421497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85e2a-7f86-4afd-ba5a-83af6af83eed admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.426486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.427282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.427565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.427838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.428563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.430328 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.431730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.432552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.433029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.433447 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.434248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.436630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.443315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1360/2736] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:17.449855 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.468356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1377/2737] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:17.470998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267736-486e-4bc0-a76f-5455587a94ce admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.472083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.479812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.480473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.481091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.481811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.483196 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.484176 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958ff9-40fe-41dc-b41d-a2917020e990 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.489784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.490636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.490917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.491190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.491736 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.492016 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.493719 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.511581 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1378/2738] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:17.511814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1361/2739] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:17.513396 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.518095 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.525039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db54cb-3808-414f-b536-fbb6c79f145d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.530360 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.531042 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.531322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.531776 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] PATH_INFO: `/v3/projects/8f51260eb65c4c45b743ac3807b3dda2/users/585e6403006545df920245c4e9f122f2/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.534087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18c80-0137-4f83-a902-d26ba4bc8c6d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.539630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.540634 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.541195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.541762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.542649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.545467 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.549180 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f51260eb65c4c45b743ac3807b3dda2, user_id=585e6403006545df920245c4e9f122f2, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.552336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e625e-0f45-4ac9-bdb7-16b27036421e admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.563900 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1362/2740] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:17.565931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.577018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1379/2741] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:17 2022] PUT /identity/v3/projects/8f51260eb65c4c45b743ac3807b3dda2/users/585e6403006545df920245c4e9f122f2/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:17.587889 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.589355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.589355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.594374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9ee23-9e6b-422a-86f6-e7762cd59559 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.629838 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] MFA Rules not processed for user `585e6403006545df920245c4e9f122f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:17.630725 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:17.686794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.688976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.689305 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.689531 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] PATH_INFO: `/v3/projects/4b77efeef4174b65a59232ed06aaf7e9/users/787c62e8eb18496d99d66c9c7f66e983/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.711494 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b77efeef4174b65a59232ed06aaf7e9, user_id=787c62e8eb18496d99d66c9c7f66e983, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.714977 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126399f-db49-4462-b1ae-86b6cde21799 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.737010 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1363/2742] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:17 2022] PUT /identity/v3/projects/4b77efeef4174b65a59232ed06aaf7e9/users/787c62e8eb18496d99d66c9c7f66e983/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:17.738371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1380/2743] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:17.746168 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.746474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.746705 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.749840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.764125 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac62df-09b1-4324-be38-73119643ffc2 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.787911 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] MFA Rules not processed for user `787c62e8eb18496d99d66c9c7f66e983`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:17.788837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:17.841981 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:17.842629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:17.842925 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:17.843154 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:17.843752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:17.856950 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:17.890569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1381/2744] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:17.898481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.905503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1364/2745] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:17.909759 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:17.929844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417882c-6dfd-41e3-b4fc-0a2acce894cb None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:17.931458 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:17.938458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:18.034741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090cabe-4284-4fff-b0c4-bce3602c6ac0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.039989 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.040594 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.041645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.041645 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.042038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.044122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.055475 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.056520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.057195 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.057836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.058718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.061670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.079906 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1382/2746] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:18.082612 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.097948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefcf22-1675-4eef-9156-a7d43e2f22d1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.106241 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1365/2747] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:18.106565 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.107534 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.107813 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.108093 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.108766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.110126 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.110653 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.127274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1383/2748] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:18.131166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.149083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d344ad-2e4a-41de-93c2-07c21400725f admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.232226 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.235526 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.235914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.236249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] PATH_INFO: `/v3/projects/2d4eec8d16e64416813113c0da3c8790/users/b7f4ba0572ed4c81b665f660f994d5b2/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.244732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720043b0-9a68-4f61-89ad-10f3721a3f4d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.253624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.253624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.253624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.253624 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.255973 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.256100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4eec8d16e64416813113c0da3c8790, user_id=b7f4ba0572ed4c81b665f660f994d5b2, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.256199 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.256408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.275288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1384/2749] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:18 2022] PUT /identity/v3/projects/2d4eec8d16e64416813113c0da3c8790/users/b7f4ba0572ed4c81b665f660f994d5b2/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:18.279595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.287453 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1366/2750] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:18 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:18.290351 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.302948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93502-eeed-4c7d-bd8f-1c1ef91a89ca admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.380656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac3d8-2cc6-4ba3-90c6-716bc38a23d0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.386054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.386936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.387357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.387831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.388588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.390840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.398952 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:18.409397 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1385/2751] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:18.414649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.421700 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.423477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.424718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.425219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.426643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.427031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116039-a612-453f-82d7-e28ea8fc20d3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.428689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.433439 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.434228 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.434669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.435030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] PATH_INFO: `/v3/projects/2d4eec8d16e64416813113c0da3c8790/users/b7f4ba0572ed4c81b665f660f994d5b2/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.437557 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4eec8d16e64416813113c0da3c8790, user_id=b7f4ba0572ed4c81b665f660f994d5b2, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.440505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5be90-719f-497b-a78c-2d0f271f2b27 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.443400 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1367/2752] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:18.447282 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.453422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1386/2753] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:18 2022] PUT /identity/v3/projects/2d4eec8d16e64416813113c0da3c8790/users/b7f4ba0572ed4c81b665f660f994d5b2/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:18.463796 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.464088 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.464322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.471536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5983-639b-486a-bda2-00bdcc69223b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.502414 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:18.502706 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] MFA Rules not processed for user `b7f4ba0572ed4c81b665f660f994d5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:18.504935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:18.588690 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.589473 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.589746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.590014 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] PATH_INFO: `/v3/projects/bdc418dbbb844c97a9ba4093c16156f0/users/de769a3c0ec84c21ac2d4c3e799e9dd7/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.595473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1387/2754] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:18.609163 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.610779 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:18.616588 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc418dbbb844c97a9ba4093c16156f0, user_id=de769a3c0ec84c21ac2d4c3e799e9dd7, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.622541 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.639132 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1368/2755] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:18 2022] PUT /identity/v3/projects/bdc418dbbb844c97a9ba4093c16156f0/users/de769a3c0ec84c21ac2d4c3e799e9dd7/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:18.643680 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.702174 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ebaca-1f08-4ce1-a903-c2d49e810f65 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.746520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc42c6-45a5-4329-9a69-568c1ab55250 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.751592 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.752287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.752631 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.752837 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.753644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.755380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.766610 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1369/2756] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:18.767720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.768649 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.768964 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.769281 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.771244 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:18.783907 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7203-a6e1-4568-b306-c64090635e6f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:18.789078 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:18.789760 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.790052 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.790341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] PATH_INFO: `/v3/projects/bdc418dbbb844c97a9ba4093c16156f0/users/de769a3c0ec84c21ac2d4c3e799e9dd7/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.792523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc418dbbb844c97a9ba4093c16156f0, user_id=de769a3c0ec84c21ac2d4c3e799e9dd7, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.795422 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f39c6f-07d7-47ff-bff3-e65ccf2f5865 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.807751 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1370/2757] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:18 2022] PUT /identity/v3/projects/bdc418dbbb844c97a9ba4093c16156f0/users/de769a3c0ec84c21ac2d4c3e799e9dd7/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:18.808785 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.809108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.809380 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.828475 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:18.833034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] MFA Rules not processed for user `510b6f993c4c47c59c936e3493d63fec`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:18.834347 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:18.855221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:18.856853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7db598-f4f5-458a-80c1-36510a402a9b service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:18.867944 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1388/2758] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:18.869350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:18.869627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:18.869895 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:18.902755 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] MFA Rules not processed for user `de769a3c0ec84c21ac2d4c3e799e9dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:18.904436 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:18.918625 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1371/2759] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:19.035596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1389/2760] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:19.068427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:19.072177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:19.120728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:19.167939 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab400ec-7649-445b-b1a4-cbc358d3d9f0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:19.177530 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:19.177728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:19.178058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:19.178562 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:19.274976 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:19.276718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4032683-defe-4fbb-9ac7-8ac2c377cc7f service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:19.292112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1372/2761] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:19.805973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:19.887713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730a0fa-ece5-4abc-9bf4-eb5bcab4ea15 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:19.893973 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:19.894618 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:19.894861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:19.895189 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] PATH_INFO: `/v3/users/585e6403006545df920245c4e9f122f2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:19.896298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585e6403006545df920245c4e9f122f2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:19.898343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:19.971803 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585e6403006545df920245c4e9f122f2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:19.972572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585e6403006545df920245c4e9f122f2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:19.973294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585e6403006545df920245c4e9f122f2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.001303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585e6403006545df920245c4e9f122f2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.003431 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:20.012562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585e6403006545df920245c4e9f122f2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.030070 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1390/2762] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:19 2022] DELETE /identity/v3/users/585e6403006545df920245c4e9f122f2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:20.034841 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:20.035345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:20.035345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:20.055353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:20.056622 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:20.125343 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1373/2763] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:20.137365 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:20.139336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:20.214388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b045e7-0973-4306-b7e5-dc265dd85d26 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:20.220297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:20.221314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:20.221713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:20.222109 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:20.234515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:20.236252 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:20.248237 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1391/2764] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:20.587454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:20.589744 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:20.620497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03d89b-2e45-4ae8-8429-f29611a17412 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:20.626292 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:20.627502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:20.627895 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:20.628277 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] PATH_INFO: `/v3/projects/8f51260eb65c4c45b743ac3807b3dda2` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:20.631390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f51260eb65c4c45b743ac3807b3dda2)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:20.634903 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:20.709568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f51260eb65c4c45b743ac3807b3dda2', 'request_id': 'req-603976c8-9637-4d5c-b1aa-7f8311d06717'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.719334 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f51260eb65c4c45b743ac3807b3dda2', 'request_id': 'req-603976c8-9637-4d5c-b1aa-7f8311d06717'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.727554 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f51260eb65c4c45b743ac3807b3dda2', 'request_id': 'req-603976c8-9637-4d5c-b1aa-7f8311d06717'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.741385 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] The token cache is being invalidate because project 8f51260eb65c4c45b743ac3807b3dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:20.741743 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.742410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.743992 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1374/2765] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:20 2022] DELETE /identity/v3/projects/8f51260eb65c4c45b743ac3807b3dda2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:20.748840 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:20.760749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efb809-5f3d-4ff7-80e1-1b330c49f624 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:20.831835 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:20.832494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:20.832646 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:20.833090 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] PATH_INFO: `/v3/users/b7f4ba0572ed4c81b665f660f994d5b2` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:20.834303 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f4ba0572ed4c81b665f660f994d5b2)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:20.836245 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:20.912562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f4ba0572ed4c81b665f660f994d5b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.913250 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f4ba0572ed4c81b665f660f994d5b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.913902 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f4ba0572ed4c81b665f660f994d5b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.935027 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f4ba0572ed4c81b665f660f994d5b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.943883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f4ba0572ed4c81b665f660f994d5b2'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:20.969713 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1392/2766] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:20 2022] DELETE /identity/v3/users/b7f4ba0572ed4c81b665f660f994d5b2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:20.996083 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:20.998804 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.016643 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:21.104437 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603976c8-9637-4d5c-b1aa-7f8311d06717 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:21.169191 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:21.171251 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.172565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.172565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.174665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.286477 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:21.289520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8b20-e619-43ab-961c-1d4f0caa2a24 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:21.302966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1375/2767] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:21.426100 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:21.428008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.440062 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:21.494749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.495250 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.495683 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.526998 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:21.530529 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.606451 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87adfd-9d24-4805-81d3-b79f296e2be3 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:21.607689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1376/2768] 10.222.0.93 () {58 vars in 1009 bytes} [Wed Aug 24 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:21.608983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:21.610628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.620644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:21.621355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.621690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.621996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] PATH_INFO: `/v3/projects/2d4eec8d16e64416813113c0da3c8790` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.624421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4eec8d16e64416813113c0da3c8790)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:21.627129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:21.646042 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c450b1-2e6f-49ae-865f-74c496dd5090 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:21.651887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:21.652215 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.652452 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.652931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] PATH_INFO: `/v3/users/b2f852d63c7846fa8106135be1ad9b01` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.654635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f852d63c7846fa8106135be1ad9b01)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:21.656386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:21.682817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:21.716763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4eec8d16e64416813113c0da3c8790', 'request_id': 'req-e7934d71-1065-4718-9620-51abbcfc6d70'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.728072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4eec8d16e64416813113c0da3c8790', 'request_id': 'req-e7934d71-1065-4718-9620-51abbcfc6d70'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.732535 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f852d63c7846fa8106135be1ad9b01'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.734116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f852d63c7846fa8106135be1ad9b01'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.734938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f852d63c7846fa8106135be1ad9b01'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.736738 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4eec8d16e64416813113c0da3c8790', 'request_id': 'req-e7934d71-1065-4718-9620-51abbcfc6d70'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.752627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f852d63c7846fa8106135be1ad9b01'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.753807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] The token cache is being invalidate because project 2d4eec8d16e64416813113c0da3c8790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:21.754096 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.755158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.757533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1393/2769] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:21 2022] DELETE /identity/v3/projects/2d4eec8d16e64416813113c0da3c8790 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:21.758134 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:21.759539 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.773671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-ac3c7de1-b68a-4b16-8f05-14e52870bfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f852d63c7846fa8106135be1ad9b01'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:21.805217 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1377/2770] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:21 2022] DELETE /identity/v3/users/b2f852d63c7846fa8106135be1ad9b01 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:21.807857 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b29f1-d134-4875-8bf1-9678c8482fef None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.809203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b29f1-d134-4875-8bf1-9678c8482fef None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.809557 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b29f1-d134-4875-8bf1-9678c8482fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.849071 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-ba1b29f1-d134-4875-8bf1-9678c8482fef None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:21.850972 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ba1b29f1-d134-4875-8bf1-9678c8482fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.861704 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7934d71-1065-4718-9620-51abbcfc6d70 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:21.904708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:21.962047 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:21.963040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.963040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.963376 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:21.965065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:21.976115 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1378/2771] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:21.978458 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984e5c-fb61-477c-a68a-06d1bee5bf5d None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:21.978802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984e5c-fb61-477c-a68a-06d1bee5bf5d None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:21.979133 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984e5c-fb61-477c-a68a-06d1bee5bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.010320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-84984e5c-fb61-477c-a68a-06d1bee5bf5d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:22.011572 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-84984e5c-fb61-477c-a68a-06d1bee5bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:22.034001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1379/2772] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:22.034001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:22.034001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:22.034001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.051409 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:22.053781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:22.064808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1394/2773] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:52:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:52:22.066301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:22.068510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:22.112120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:22.113287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:22.132741 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1380/2774] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:22.138727 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:22.149614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feb6e6-704c-47d3-8884-ec10e05b977e None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:22.182454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:22.183371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:22.183787 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:22.184122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.185032 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:22.185465 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:22.187123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:22.229226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1381/2775] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:22.229226 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:22.230272 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:22.424614 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4efa99-dcd3-488c-9f4b-7ea7e3a86651 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:22.438640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:22.442621 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:22.443486 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:22.444661 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.448737 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:22.522202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:22.540519 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c4961-0dd4-4fc3-9fe2-87d9f7d5c8b6 service swift] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:22.564514 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:22.565355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:22.565632 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:22.566082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.609017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:22.610983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:22.632791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1395/2776] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:22.633923 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:22.658517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10e34-0bec-4fde-94ee-07346c1d0ca8 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:22.673021 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:22.673553 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:22.673979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:22.674248 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:22.675285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:22.688894 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:22.719216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:22.722253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:22.755325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1382/2777] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:22.782999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1396/2778] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:22 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:22.786309 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:22.827660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080448-3c89-4b96-a78a-3ad501c397fe service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:23.013349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:23.014153 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.014956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.015966 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.016963 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:23.019183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:23.068856 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1383/2779] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:22 2022] POST /identity/v3/users => generated 281 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:23.075321 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:23.095936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebfc84-1ce2-4e94-ab2c-c3c648de09a4 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:23.110133 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:23.111686 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.113234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.113994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.115523 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:23.122744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:23.171843 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1397/2780] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:23.177124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:23.200254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d971-4c2c-4d07-bcad-180e1cc48d4c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:23.243455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:23.244418 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.244850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.245435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.246796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:23.249825 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:23.284248 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1384/2781] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:23.288992 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:23.321766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803de00-ca14-4198-b639-c850fc1db853 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:23.340113 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:23.341510 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.342608 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.342882 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] PATH_INFO: `/v3/projects/cc662b2fa56743ec88817421ffbc9520/users/85b5031a1ce948578f0810faa8e9b0db/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.387963 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc662b2fa56743ec88817421ffbc9520, user_id=85b5031a1ce948578f0810faa8e9b0db, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:23.389442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:23.391551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:23.402781 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af3c7e-204e-4f3f-aa86-2164b43479c4 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:23.421246 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d68cc-42ad-4702-8d8e-4b396a59e469 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:23.449009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1398/2782] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:23 2022] PUT /identity/v3/projects/cc662b2fa56743ec88817421ffbc9520/users/85b5031a1ce948578f0810faa8e9b0db/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:23.456527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.458287 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.458940 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.508635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:23.509968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.510253 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.512301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] PATH_INFO: `/v3/projects/a71ed20a28394fa1bc0a2b4a1252590d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.516125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71ed20a28394fa1bc0a2b4a1252590d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:23.520062 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:23.527975 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] MFA Rules not processed for user `85b5031a1ce948578f0810faa8e9b0db`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:23.530220 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:23.555010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:23.605333 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:23.623037 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71ed20a28394fa1bc0a2b4a1252590d', 'request_id': 'req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:23.639916 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71ed20a28394fa1bc0a2b4a1252590d', 'request_id': 'req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:23.657101 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71ed20a28394fa1bc0a2b4a1252590d', 'request_id': 'req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:23.686167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] The token cache is being invalidate because project a71ed20a28394fa1bc0a2b4a1252590d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:23.686640 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:23.687695 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-a55e4e22-e272-46ef-b2d2-b2c2cbaf1d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:23.691167 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1385/2783] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:23 2022] DELETE /identity/v3/projects/a71ed20a28394fa1bc0a2b4a1252590d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:23.709861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aa18-38a2-492a-a409-ef99012996b1 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:23.710416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aa18-38a2-492a-a409-ef99012996b1 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:23.710901 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aa18-38a2-492a-a409-ef99012996b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:23.744955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1399/2784] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:23.777254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4b14aa18-38a2-492a-a409-ef99012996b1 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:23.780307 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4b14aa18-38a2-492a-a409-ef99012996b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:23.808264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:23.811175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:24.001016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1386/2785] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:24.009367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.009808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.010131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.017650 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5224c-dd92-4d45-a57d-49326f82824a None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.041645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:24.053679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:24.086337 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1387/2786] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:24.093659 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.159902 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571b377-6fb4-4342-8d91-617b4ff5feaa None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.174611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.175515 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.176007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.178397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.180034 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88171) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:24.180359 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.182049 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.239774 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1388/2787] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:24.241856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.243777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.244555 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.245201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.245699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.279089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135e088-1bb8-4e9f-b64e-2ee201c11b87 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.304735 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.305684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.306185 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.306594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.308420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.322365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.375547 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.378089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.396060 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1400/2788] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:24.424221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.425875 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:24.434114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1389/2789] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:24 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:24.440682 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.461240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b2119-28a2-46e4-bd11-57a763bfa79c service cinder] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.505616 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:24.594756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be53a4-7725-4fd9-9200-9d4780fc3126 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.610312 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.612124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.614551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.615090 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.615994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.619031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.619712 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.619997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.620265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] PATH_INFO: `/v3/users/85b5031a1ce948578f0810faa8e9b0db` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.622234 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.622371 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b5031a1ce948578f0810faa8e9b0db)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.624967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.682994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1390/2790] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:24 2022] POST /identity/v3/users => generated 291 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:24.687447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.717360 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90925476-3ff7-434c-b30f-eeb8cbdd78de admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.731123 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.732184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.732732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.734072 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.735271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.741158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.765107 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1391/2791] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:24.766694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.784096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:24.784991 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b5031a1ce948578f0810faa8e9b0db'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:24.786119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b5031a1ce948578f0810faa8e9b0db'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:24.789310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b5031a1ce948578f0810faa8e9b0db'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:24.791924 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bb8b0-e8c0-4ee8-a798-fe7641e909ef admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.809286 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.810503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.810932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.811069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.811734 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.813435 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.828472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b5031a1ce948578f0810faa8e9b0db'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:24.845460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1392/2792] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:24.845460 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:24.851933 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:24.852561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f1a30204-7062-4683-b884-6bc26dcefa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b5031a1ce948578f0810faa8e9b0db'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:24.879573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6f214-3340-4978-9ee5-801c6407fbf0 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:24.883955 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1401/2793] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:24 2022] DELETE /identity/v3/users/85b5031a1ce948578f0810faa8e9b0db => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:24.890126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.890600 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.893304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.893559 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:24.894261 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.894539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.894810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] PATH_INFO: `/v3/projects/24c1b0758f2b42619042a22a09c7213c/users/b6b10c3531424b98bf0e45f5c2f2d4ed/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:24.924179 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:24.925863 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:24.935455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c1b0758f2b42619042a22a09c7213c, user_id=b6b10c3531424b98bf0e45f5c2f2d4ed, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:24.938442 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45942a-8377-44ba-a7cc-e48eb7eb9597 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:24.961390 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1393/2794] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:24 2022] PUT /identity/v3/projects/24c1b0758f2b42619042a22a09c7213c/users/b6b10c3531424b98bf0e45f5c2f2d4ed/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:24.972926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:24.973267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:24.973498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:25.016817 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] MFA Rules not processed for user `b6b10c3531424b98bf0e45f5c2f2d4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:25.018747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:25.059380 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1402/2795] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:25.075886 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:25.077748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:25.148728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1394/2796] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:25.157672 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:25.165273 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:25.167717 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:25.179148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20a96-7070-4a04-99d5-df7609d4df35 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:25.330171 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:25.331241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:25.331241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:25.331241 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:25.358295 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350877-6249-4b0b-affa-933c2afeb874 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:25.363507 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:25.364754 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:25.365120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:25.365404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:25.379431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:25.381783 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:25.397074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1395/2797] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:25.507593 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:25.509097 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d38551-ab22-4d5c-85b6-6849466d34a6 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:25.522352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1403/2798] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:26.173649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.176523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:26.192365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012f47-32cb-4e65-b167-181b178dcb1c service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.236067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.236746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.237068 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.237317 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] PATH_INFO: `/v3/projects/cc662b2fa56743ec88817421ffbc9520` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.238669 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc662b2fa56743ec88817421ffbc9520)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.241088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.329523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc662b2fa56743ec88817421ffbc9520', 'request_id': 'req-99963512-6982-4ed8-83a8-69a006055742'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:26.340836 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc662b2fa56743ec88817421ffbc9520', 'request_id': 'req-99963512-6982-4ed8-83a8-69a006055742'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:26.343194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:26.354550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc662b2fa56743ec88817421ffbc9520', 'request_id': 'req-99963512-6982-4ed8-83a8-69a006055742'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:26.368670 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] The token cache is being invalidate because project cc662b2fa56743ec88817421ffbc9520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:26.369883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:26.370718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-99963512-6982-4ed8-83a8-69a006055742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:26.372583 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1396/2799] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:26 2022] DELETE /identity/v3/projects/cc662b2fa56743ec88817421ffbc9520 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:26.380309 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.380846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.380846 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.447550 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:26.449506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:26.536827 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1404/2800] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:26.546342 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.546660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.546887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.571177 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:26.572706 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:26.582497 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1397/2801] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:26.586990 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.598040 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b4a2b-7139-489a-a02b-9e93b5ad1f7d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.603149 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.603783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.604055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.604325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.605195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:26.605441 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.607198 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.628326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1405/2802] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:26.633274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.645629 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68caf-4b80-43ef-b8ce-f784a20beff7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.651872 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.652525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.652794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.653118 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.653832 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.655823 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.689085 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1398/2803] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:26 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:26.692783 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.705162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a891e-9afc-471f-a067-b8800d86bda9 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.757743 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:26.794682 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.795322 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.795601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.795874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.796968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.799017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.834887 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1406/2804] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:26 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:26.841724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.859135 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f006b-a96a-4937-a93c-eb7c0b9c372f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.865224 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.866346 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.866887 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.867420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.868662 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.871330 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.886779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1399/2805] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:26.891238 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.904388 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4b72-09ed-4491-98e6-5cbef5f0a271 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.911718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.912535 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.912938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.913263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:26.914071 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:26.915801 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3bffb-a233-4b65-9762-f85ede1102a8 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:26.941057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1407/2806] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:26.945538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:26.960553 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8836c2-0785-4b97-bef4-6c95fecd2e9b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:26.985686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:26.986968 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:26.989180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:26.989732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] PATH_INFO: `/v3/projects/a9be156e93964d7c8de073f38b666ea9/users/aa8de8be287b4beabf33b2d7959c81bb/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:27.014410 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9be156e93964d7c8de073f38b666ea9, user_id=aa8de8be287b4beabf33b2d7959c81bb, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:27.017794 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:27.051386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1400/2807] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:26 2022] PUT /identity/v3/projects/a9be156e93964d7c8de073f38b666ea9/users/aa8de8be287b4beabf33b2d7959c81bb/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:27.057351 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:27.057636 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:27.058038 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:27.079170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:27.080795 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:27.172083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1408/2808] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:27.182767 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:27.184684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:27.299020 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903556-e70c-47ca-8d6a-e71f4eadcd8d admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:27.303183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:27.303869 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:27.304148 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:27.304420 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:27.317245 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:27.318861 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136488-17a1-4714-892d-32fdced4c5e2 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:27.333301 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1401/2809] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:27.568744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:27.570221 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:27.592121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7a26e-7bbf-48d8-955b-abde2823ee20 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:27.605710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:27.606541 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:27.606817 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:27.607087 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] PATH_INFO: `/v3/users/2dea9bc1282e4adfbf268d7481fc9a33` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:27.608310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dea9bc1282e4adfbf268d7481fc9a33)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:27.610297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:27.684821 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dea9bc1282e4adfbf268d7481fc9a33'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:27.686372 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dea9bc1282e4adfbf268d7481fc9a33'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:27.687387 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dea9bc1282e4adfbf268d7481fc9a33'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:27.717999 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dea9bc1282e4adfbf268d7481fc9a33'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:27.732383 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dea9bc1282e4adfbf268d7481fc9a33'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:27.765382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1409/2810] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:27 2022] DELETE /identity/v3/users/2dea9bc1282e4adfbf268d7481fc9a33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:27.766599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:27.767130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:27.767130 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:27.803061 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:27.807406 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:27.956413 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1402/2811] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:27.967126 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:27.968731 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:28.059873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:28.123129 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f0d8-05eb-40ae-84ed-5915b3fe0242 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:28.127946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:28.128946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:28.129130 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:28.129326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:28.145240 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:28.146941 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc8f67-8c57-4694-b3e7-c1bf0011cd3e service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:28.176444 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1410/2812] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:28.328190 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:28.329851 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:28.349718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec31f-0beb-409f-ada4-cbd4396009d2 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:28.364340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:28.365296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:28.365724 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:28.365994 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] PATH_INFO: `/v3/users/b6b10c3531424b98bf0e45f5c2f2d4ed` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:28.369573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b10c3531424b98bf0e45f5c2f2d4ed)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:28.371518 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:28.455397 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:28.515030 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b10c3531424b98bf0e45f5c2f2d4ed'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:28.517158 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b10c3531424b98bf0e45f5c2f2d4ed'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:28.520201 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b10c3531424b98bf0e45f5c2f2d4ed'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:28.551180 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b10c3531424b98bf0e45f5c2f2d4ed'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:28.572096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b10c3531424b98bf0e45f5c2f2d4ed'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:28.604341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1403/2813] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:28 2022] DELETE /identity/v3/users/b6b10c3531424b98bf0e45f5c2f2d4ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:28.605951 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:28.606601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:28.606601 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:28.660012 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:28.662759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:28.793234 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1411/2814] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:28.839983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:28.841932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:28.948339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:28.949812 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:28.967331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cc5e1-25ad-40c7-9b80-82f4ace2da03 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:28.969036 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8737a-2278-4d3f-9ff7-a8ba2dc9b7e4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:28.981681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:28.983946 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:28.984222 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:28.984493 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:28.986966 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:28.987624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:28.987896 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:28.988158 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] PATH_INFO: `/v3/projects/6920439fe6354c0ebd27fa73ab2f4b3b` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:28.991254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6920439fe6354c0ebd27fa73ab2f4b3b)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:28.994318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:29.015310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:29.016951 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:29.039881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1404/2815] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:29.093724 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6920439fe6354c0ebd27fa73ab2f4b3b', 'request_id': 'req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.108815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6920439fe6354c0ebd27fa73ab2f4b3b', 'request_id': 'req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.125718 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6920439fe6354c0ebd27fa73ab2f4b3b', 'request_id': 'req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.165564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] The token cache is being invalidate because project 6920439fe6354c0ebd27fa73ab2f4b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:29.165862 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.166644 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.169884 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1412/2816] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:28 2022] DELETE /identity/v3/projects/6920439fe6354c0ebd27fa73ab2f4b3b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:29.173490 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:29.190320 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da367c3-a51c-4d4d-b003-07c96a552ade service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:29.305430 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:29.306310 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:29.306684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:29.306926 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] PATH_INFO: `/v3/users/787c62e8eb18496d99d66c9c7f66e983` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:29.313308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787c62e8eb18496d99d66c9c7f66e983)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:29.318459 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:29.469569 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:29.498053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787c62e8eb18496d99d66c9c7f66e983'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.500922 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787c62e8eb18496d99d66c9c7f66e983'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.502254 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787c62e8eb18496d99d66c9c7f66e983'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.535934 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787c62e8eb18496d99d66c9c7f66e983'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.557611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-b98bf25a-2001-49db-a9d9-896449513da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787c62e8eb18496d99d66c9c7f66e983'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:29.584679 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1405/2817] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:29 2022] DELETE /identity/v3/users/787c62e8eb18496d99d66c9c7f66e983 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:52:29.988851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:29.988851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:30.022742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee5b9d-ded7-4ea9-8393-1979e352e7c0 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:30.176630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:30.191879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:30.193455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.195264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.195629 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] PATH_INFO: `/v3/projects/24c1b0758f2b42619042a22a09c7213c` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.197051 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c1b0758f2b42619042a22a09c7213c)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:30.199089 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:30.305121 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c1b0758f2b42619042a22a09c7213c', 'request_id': 'req-09fae476-b9f3-455f-8e8d-8067dd89f164'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.320382 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c1b0758f2b42619042a22a09c7213c', 'request_id': 'req-09fae476-b9f3-455f-8e8d-8067dd89f164'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.336853 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c1b0758f2b42619042a22a09c7213c', 'request_id': 'req-09fae476-b9f3-455f-8e8d-8067dd89f164'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.361980 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] The token cache is being invalidate because project 24c1b0758f2b42619042a22a09c7213c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:30.362310 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.366293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-09fae476-b9f3-455f-8e8d-8067dd89f164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.374247 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1413/2818] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:29 2022] DELETE /identity/v3/projects/24c1b0758f2b42619042a22a09c7213c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:30.375975 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.376847 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.377287 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.409308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:30.412573 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:30.567987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.568272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.568808 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.572371 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1406/2819] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:30.593018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:30.594539 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:30.631638 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:30.635574 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5f187-cd94-46a2-b96c-957f39018ec3 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:30.636552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:30.661594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:30.661594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.661594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.661594 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] PATH_INFO: `/v3/projects/4b77efeef4174b65a59232ed06aaf7e9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.662081 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b77efeef4174b65a59232ed06aaf7e9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:30.662823 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1414/2820] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:30.663968 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:30.664324 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:30.683449 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac328f-e36f-49fa-9b52-d8c54c2c1099 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:30.699457 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:30.700141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.700422 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.701319 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.702031 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:30.702335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:30.704150 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:30.723352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1415/2821] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:52:30.729561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:30.746122 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f0d8b-e4a2-4774-91ae-09b4fba828a6 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:30.752270 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:30.753202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.753485 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.753757 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] PATH_INFO: `/v3/projects` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.754406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:30.756669 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:30.794122 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b77efeef4174b65a59232ed06aaf7e9', 'request_id': 'req-7d49266c-c048-44ef-a33a-5bfc978a3b66'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.804945 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1416/2822] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:30 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:30.812416 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:30.821732 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b77efeef4174b65a59232ed06aaf7e9', 'request_id': 'req-7d49266c-c048-44ef-a33a-5bfc978a3b66'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.836835 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b77efeef4174b65a59232ed06aaf7e9', 'request_id': 'req-7d49266c-c048-44ef-a33a-5bfc978a3b66'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.862536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] The token cache is being invalidate because project 4b77efeef4174b65a59232ed06aaf7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:30.862536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.865714 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:30.869289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1407/2823] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:30 2022] DELETE /identity/v3/projects/4b77efeef4174b65a59232ed06aaf7e9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:30.873313 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:30.877890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:30.976861 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14db7e-3e1c-4f9e-bff2-2deac1a054db admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:30.992777 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:30.995516 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:30.997705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:30.997885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:30.998099 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:30.998922 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.002474 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.068595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1417/2824] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:30 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:31.069752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:31.077104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49266c-c048-44ef-a33a-5bfc978a3b66 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.078517 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:31.097948 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.099479 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.100018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.100528 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] PATH_INFO: `/v3/users/de769a3c0ec84c21ac2d4c3e799e9dd7` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.105988 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=de769a3c0ec84c21ac2d4c3e799e9dd7)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.108468 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.114501 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e7e21-3d31-4d30-bee3-0d991ebeffe1 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.158148 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.165468 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.167590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.168010 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.169194 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.176056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.210587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1418/2825] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:31.219056 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:31.223810 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de769a3c0ec84c21ac2d4c3e799e9dd7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:31.225259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de769a3c0ec84c21ac2d4c3e799e9dd7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:31.226136 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de769a3c0ec84c21ac2d4c3e799e9dd7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:31.248688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb52464-a9b7-4c57-89d0-1ad176099fae admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.259844 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de769a3c0ec84c21ac2d4c3e799e9dd7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:31.262370 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.263464 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.264967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.265473 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.267206 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.270146 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.278833 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-05fe0aa0-8d00-4b02-83bd-632a9a9abdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de769a3c0ec84c21ac2d4c3e799e9dd7'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:31.303588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1419/2826] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:31.307926 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:31.309194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1408/2827] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:30 2022] DELETE /identity/v3/users/de769a3c0ec84c21ac2d4c3e799e9dd7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:31.310602 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:31.359656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb786-3a04-400c-8dfe-3a6815784acd admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.379643 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:31.513585 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.514879 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.515568 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.515942 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] PATH_INFO: `/v3/projects/7dc8ef32ffad4d45828b674feee0adc0/users/8c3c4d82d3f7427083bab52696d8ec60/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.550151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc8ef32ffad4d45828b674feee0adc0, user_id=8c3c4d82d3f7427083bab52696d8ec60, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.555297 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.581251 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1420/2828] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:31 2022] PUT /identity/v3/projects/7dc8ef32ffad4d45828b674feee0adc0/users/8c3c4d82d3f7427083bab52696d8ec60/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:31.586472 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.587058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.587517 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.640084 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:31.641378 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:31.783628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1409/2829] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:31.840318 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:31.842186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:31.912815 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:31.915050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:31.938165 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092835c-d94b-4f7c-8b99-73dc082660e0 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.947289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.948102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.948225 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.948537 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] PATH_INFO: `/v3/projects/bdc418dbbb844c97a9ba4093c16156f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.949730 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc418dbbb844c97a9ba4093c16156f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.951858 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:31.973437 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b09f29-be69-4c53-a957-086b79c48c2d admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:31.977497 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:31.978261 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:31.978611 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:31.978978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:31.992477 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:31.994265 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ffbf1-45d4-4f61-851a-219568950a2c service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.007912 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1421/2830] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:32.016960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc418dbbb844c97a9ba4093c16156f0', 'request_id': 'req-e1da16b2-479e-432a-9022-ccc110732382'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:32.032409 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc418dbbb844c97a9ba4093c16156f0', 'request_id': 'req-e1da16b2-479e-432a-9022-ccc110732382'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:32.035715 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:32.042696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc418dbbb844c97a9ba4093c16156f0', 'request_id': 'req-e1da16b2-479e-432a-9022-ccc110732382'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:32.056753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] The token cache is being invalidate because project bdc418dbbb844c97a9ba4093c16156f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:32.057209 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:32.058088 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-e1da16b2-479e-432a-9022-ccc110732382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:32.063931 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1410/2831] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:31 2022] DELETE /identity/v3/projects/bdc418dbbb844c97a9ba4093c16156f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:32.065354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.065640 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.065917 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.087771 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:32.089584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:32.175978 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1422/2832] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:52:32.185762 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.186546 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.187639 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.230364 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:32.232533 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:32.256341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1411/2833] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:32.260971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.272730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd251-760a-4181-8155-6ac25f0f17dd None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.278108 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.278822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.279165 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.279499 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.280399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:52:32.280759 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.282708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.302423 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1423/2834] 10.222.0.93 () {58 vars in 1153 bytes} [Wed Aug 24 15:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:52:32.307880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.318701 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c470-98c8-4236-8280-ea4d048bc4cd None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.324613 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.325349 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.325684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.325888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.326514 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.328455 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.376336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1412/2835] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:32 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:52:32.380434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.393336 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da318b-2dd0-462f-b3da-fb8d0c21ffe7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.429949 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:32.498548 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.499170 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.499455 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.499732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] PATH_INFO: `/v3/users` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.500329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.502306 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.533254 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1424/2836] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:32 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:32.539667 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.561660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321eeda-aa11-4910-b739-dbbba8710726 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.568140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.568780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.569089 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.569399 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] PATH_INFO: `/v3/roles` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.579476 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.580616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.593591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1413/2837] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:32.597998 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.611767 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac2318-3589-4f63-b619-f52c30729972 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.616883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.617752 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.618022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.618288 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.619914 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.621908 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c7a8-3c41-40a9-941e-bb05001fee97 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.635994 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1425/2838] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:52:32.640788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.657154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf21a31-f3bf-4fd5-8da0-1b0aa042c236 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.665536 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.665885 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.666066 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.666331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] PATH_INFO: `/v3/projects/12e5865c3a1d4989a57905716f90582f/users/f6bad6fc6fc349efb5f4c987b5791efe/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.687039 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e5865c3a1d4989a57905716f90582f, user_id=f6bad6fc6fc349efb5f4c987b5791efe, role_id=694d6cd3ab834a1ebe064dcbf4e9d3f0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.690336 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.714665 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1414/2839] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:32 2022] PUT /identity/v3/projects/12e5865c3a1d4989a57905716f90582f/users/f6bad6fc6fc349efb5f4c987b5791efe/roles/694d6cd3ab834a1ebe064dcbf4e9d3f0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:32.725694 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a0676-ca56-483a-aacf-f4191d80e831 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.726007 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a0676-ca56-483a-aacf-f4191d80e831 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.726429 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a0676-ca56-483a-aacf-f4191d80e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.761720 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-8b6a0676-ca56-483a-aacf-f4191d80e831 None None] MFA Rules not processed for user `f6bad6fc6fc349efb5f4c987b5791efe`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:32.763066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-8b6a0676-ca56-483a-aacf-f4191d80e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:32.848500 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1426/2840] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:32.862394 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:32.865274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:32.956729 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd9c6-8772-49b7-b0fd-dadaa95206a4 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:32.961386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:32.962235 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:32.962898 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:32.963269 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:32.974929 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:32.976520 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:32.990075 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1415/2841] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:33.841459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e862-45bd-46f4-a34f-f1c769bcb5ec None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:33.841979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e862-45bd-46f4-a34f-f1c769bcb5ec None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:33.841979 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295e862-45bd-46f4-a34f-f1c769bcb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:33.897202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-d295e862-45bd-46f4-a34f-f1c769bcb5ec None None] MFA Rules not processed for user `8c3c4d82d3f7427083bab52696d8ec60`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:33.898690 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d295e862-45bd-46f4-a34f-f1c769bcb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:34.028190 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1427/2842] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:34.037213 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:34.051038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fe9db-5795-4442-be0d-6ecb6e19aee0 service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:34.055638 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620b3bc47e241b18a60bd7f43fd4f57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:34.056285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:34.056563 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:34.056838 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:34.072203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:34.074000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:34.089285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1416/2843] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:35.412127 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600358-4581-402e-b1a8-2c21a3d329d7 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:35.413002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600358-4581-402e-b1a8-2c21a3d329d7 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:35.413002 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600358-4581-402e-b1a8-2c21a3d329d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:35.443744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-c1600358-4581-402e-b1a8-2c21a3d329d7 None None] MFA Rules not processed for user `aa8de8be287b4beabf33b2d7959c81bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:35.445053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-c1600358-4581-402e-b1a8-2c21a3d329d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:35.457224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:35.564570 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1428/2844] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:35.569353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:35.570814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:35.663416 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab114-6ed4-4e82-8cd5-b94a2935ed2d service cinder] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:35.668747 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:35.669391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:35.669675 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:35.669945 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] PATH_INFO: `/v3/projects` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:35.670591 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:35.672492 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:35.696232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:35.733210 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:35.733481 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:35.733805 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:35.740982 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1417/2845] 10.222.0.93 () {60 vars in 1153 bytes} [Wed Aug 24 15:52:35 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:35.745116 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:35.760654 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] MFA Rules not processed for user `8c3c4d82d3f7427083bab52696d8ec60`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:35.761160 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:35.841599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a047f-91b2-4714-bd97-6e6f0c15b22b admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:35.847233 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:35.847868 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:35.848141 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:35.848404 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] PATH_INFO: `/v3/users` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:35.849110 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:35.851840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:35.879786 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1429/2846] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:35.899274 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1418/2847] 10.222.0.93 () {60 vars in 1144 bytes} [Wed Aug 24 15:52:35 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:52:35.904566 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:35.920386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45534e-6bb3-4afa-b3f3-4e995ea9b87e None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:35.926521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:35.927405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:35.927747 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:35.928081 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:35.928807 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:35.930971 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:35.961630 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1430/2848] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:35.966302 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:35.983431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb8aa-c8ec-4eea-acb4-4dda6b10a654 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:35.998166 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:35.999979 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:36.000846 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:36.001570 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] PATH_INFO: `/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0/users/a13ee034e55c4e5ab6e2a5617f355569/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:36.038006 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8291ca79c5a4b4aafe40717444c0cd0, user_id=a13ee034e55c4e5ab6e2a5617f355569, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:36.042183 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:36.071216 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1419/2849] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:35 2022] PUT /identity/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0/users/a13ee034e55c4e5ab6e2a5617f355569/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:36.073140 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:36.089375 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d612-3946-4e69-8e1c-89930ba27775 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:36.205836 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:36.206613 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:36.207178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:36.207512 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] PATH_INFO: `/v3/roles` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:36.208285 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:36.210858 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:36.238892 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1431/2850] 10.222.0.93 () {58 vars in 1122 bytes} [Wed Aug 24 15:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:52:36.239750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:36.253264 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc21d6e-1967-4163-9703-e1358d9246f2 admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:36.258630 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:36.259379 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] REQUEST_METHOD: `PUT` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:36.259718 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:36.260664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] PATH_INFO: `/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0/users/a13ee034e55c4e5ab6e2a5617f355569/roles/4d4c76bf767c44dea45214aa522e6f3e` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:36.264327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8291ca79c5a4b4aafe40717444c0cd0, user_id=a13ee034e55c4e5ab6e2a5617f355569, role_id=4d4c76bf767c44dea45214aa522e6f3e)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:36.267642 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa69fef-82f6-4231-9c98-c846e842e5af admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:36.284487 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1420/2851] 10.222.0.93 () {60 vars in 1483 bytes} [Wed Aug 24 15:52:36 2022] PUT /identity/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0/users/a13ee034e55c4e5ab6e2a5617f355569/roles/4d4c76bf767c44dea45214aa522e6f3e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:44.940231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:44.952809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0ce6f-be48-479a-80b9-466d8535379b admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:45.027957 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:45.045353 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:45.046427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:45.046427 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:45.070778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:45.071656 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:45.072079 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:45.072358 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] PATH_INFO: `/v3/users/f6bad6fc6fc349efb5f4c987b5791efe` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:45.074709 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bad6fc6fc349efb5f4c987b5791efe)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:45.078230 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:45.145156 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] MFA Rules not processed for user `a13ee034e55c4e5ab6e2a5617f355569`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:45.147096 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:45.204888 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bad6fc6fc349efb5f4c987b5791efe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:45.206255 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bad6fc6fc349efb5f4c987b5791efe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:45.207015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bad6fc6fc349efb5f4c987b5791efe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:45.244948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bad6fc6fc349efb5f4c987b5791efe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:45.257749 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-34f182b1-9e71-4096-bb30-7e0dbde50e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bad6fc6fc349efb5f4c987b5791efe'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:45.285622 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1432/2852] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:52:44 2022] DELETE /identity/v3/users/f6bad6fc6fc349efb5f4c987b5791efe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:45.291355 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:45.291997 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:45.292587 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:45.295860 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1421/2853] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:45.312510 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:45.314644 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:45.325231 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:45.327078 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:45.374478 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:45.413688 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1433/2854] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:45.437741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:45.438386 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dc903-a17f-4cb4-a7b1-1ef101453b03 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:45.439852 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:45.597307 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c599-9332-425f-b143-1051176f2e36 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:45.609627 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:45.611408 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:45.612057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:45.612809 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:45.623053 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:45.627265 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:45.627761 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:45.628229 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:45.636021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:45.638294 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:45.643766 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:45.659386 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1434/2855] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:45.814232 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:45.820941 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:45.838412 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1422/2856] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:52:46.308564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:46.313948 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:46.327438 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:46.334721 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f2f35-efb8-48e2-9c7d-b1e89fe018ef service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:46.353822 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:46.354574 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:46.354873 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:46.355136 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] PATH_INFO: `/v3/projects/12e5865c3a1d4989a57905716f90582f` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:46.357859 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e5865c3a1d4989a57905716f90582f)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:46.360024 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:46.447530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e5865c3a1d4989a57905716f90582f', 'request_id': 'req-7119fc0e-646d-471c-ae33-2e7056901c21'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:46.473463 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e5865c3a1d4989a57905716f90582f', 'request_id': 'req-7119fc0e-646d-471c-ae33-2e7056901c21'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:46.490504 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e5865c3a1d4989a57905716f90582f', 'request_id': 'req-7119fc0e-646d-471c-ae33-2e7056901c21'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:46.513244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] The token cache is being invalidate because project 12e5865c3a1d4989a57905716f90582f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:52:46.513883 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:46.515293 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7119fc0e-646d-471c-ae33-2e7056901c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:52:46.518186 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1435/2857] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:52:46 2022] DELETE /identity/v3/projects/12e5865c3a1d4989a57905716f90582f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:52:47.161565 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:47.164236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:47.186811 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa0f4a-81a5-45cd-8f4b-bd1fccab01a0 service nova] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:47.329050 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:47.329792 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:47.330069 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:47.330340 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:47.345454 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:47.506781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=100 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:47.659447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:47.661077 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:47.697194 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1423/2858] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:48.103604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ae4a-7e4d-44df-90fa-221dd1608fdf None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:48.104851 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ae4a-7e4d-44df-90fa-221dd1608fdf None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:48.105515 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366ae4a-7e4d-44df-90fa-221dd1608fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:48.154345 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-9366ae4a-7e4d-44df-90fa-221dd1608fdf None None] MFA Rules not processed for user `aa8de8be287b4beabf33b2d7959c81bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:52:48.155708 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-9366ae4a-7e4d-44df-90fa-221dd1608fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:48.234521 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1436/2859] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:52:50.492308 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:52:50.494027 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:50.671696 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0c1b-8090-4039-a722-e6960e557c06 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:52:50.692149 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72661a05-bc81-486e-8539-7116518965cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:52:50.693599 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661a05-bc81-486e-8539-7116518965cb service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:52:50.695919 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661a05-bc81-486e-8539-7116518965cb service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:52:50.696498 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661a05-bc81-486e-8539-7116518965cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:52:50.708040 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-72661a05-bc81-486e-8539-7116518965cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:52:50.731382 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72661a05-bc81-486e-8539-7116518965cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:52:50.733405 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72661a05-bc81-486e-8539-7116518965cb service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:52:50.751848 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1424/2860] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:52:58.225263 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:00.742074 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=53 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:15.861434 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:15.862065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:15.862065 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:15.961343 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:15.962561 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:16.083663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1437/2861] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:16.100745 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72661a05-bc81-486e-8539-7116518965cb service nova] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:16.172325 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72661a05-bc81-486e-8539-7116518965cb service nova] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:16.179983 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:16.180677 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:16.181000 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:16.181294 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:16.190765 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:16.192403 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd177af-289e-45ec-95e6-e34b964110a1 service nova] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:16.202672 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1425/2862] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:18.418331 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:18.421797 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:18.442680 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e2a52-78b0-4486-817a-776a6b38938d None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:18.448421 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:18.449472 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:18.449947 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:18.450405 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:18.453166 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:18.533542 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:18.535083 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:18.547224 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1438/2863] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:19.989267 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67612-497c-4323-be11-729f43a5943f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:19.990271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67612-497c-4323-be11-729f43a5943f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:19.990271 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d67612-497c-4323-be11-729f43a5943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:20.016689 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-51d67612-497c-4323-be11-729f43a5943f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:20.017950 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-51d67612-497c-4323-be11-729f43a5943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:20.028779 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1426/2864] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:20.048356 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:20.057244 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=100 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:20.064584 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebba54-c330-44df-aafc-348e1ba737bb service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:20.070728 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:20.071381 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:20.071665 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:20.071935 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:20.092348 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:20.095292 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:20.112399 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1439/2865] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:25.333108 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed2c-acad-493b-b4d2-1121b20a7f30 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:25.333710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed2c-acad-493b-b4d2-1121b20a7f30 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:25.333710 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04ed2c-acad-493b-b4d2-1121b20a7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:25.356184 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-2c04ed2c-acad-493b-b4d2-1121b20a7f30 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:25.357702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2c04ed2c-acad-493b-b4d2-1121b20a7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:25.366172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1427/2866] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:25.383202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:25.395527 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5332-514f-45f3-b1cd-34fe51e12cfd service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:25.403272 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:25.404430 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:25.404828 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:25.405329 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:25.419339 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:25.421558 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:25.432511 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1440/2867] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:28.470897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488abf-0e8e-4e0d-ad83-5844118a79eb None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:28.471551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488abf-0e8e-4e0d-ad83-5844118a79eb None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:28.471551 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488abf-0e8e-4e0d-ad83-5844118a79eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:28.492365 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-96488abf-0e8e-4e0d-ad83-5844118a79eb None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:28.493664 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-96488abf-0e8e-4e0d-ad83-5844118a79eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:28.503098 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1428/2868] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:53:28.518506 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:28.520153 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:28.555591 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433875-fda2-404c-a2c8-acb0e5b65db3 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:28.561446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:28.562069 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:28.562341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:28.562604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:28.570959 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:28.572572 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:28.583442 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1441/2869] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:31.648058 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92534-919b-4566-9b3a-c11bca25d151 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:31.648647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92534-919b-4566-9b3a-c11bca25d151 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:31.648647 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92534-919b-4566-9b3a-c11bca25d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:31.679603 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-b2d92534-919b-4566-9b3a-c11bca25d151 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:31.680781 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-b2d92534-919b-4566-9b3a-c11bca25d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:31.689561 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1429/2870] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:31.705961 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:31.718082 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bb37b-caf1-493b-984b-c8efd180d0e3 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:31.724357 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:31.725015 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:31.725301 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:31.725569 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:31.734874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:31.736486 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:31.747041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1442/2871] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:34.853375 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:34.854035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:34.854035 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:34.877893 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:34.879134 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:34.887671 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1430/2872] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:34.906119 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:34.919144 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83ecdb-a5bd-4f26-b317-799e8d98c405 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:34.925433 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:34.926114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:34.926393 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:34.926684 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:34.936533 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:34.938175 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabf728-984f-482a-8bac-7f48a40da038 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:34.948378 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1443/2873] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:53:44.871719 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=45 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:44.943791 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=34 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:53:46.042408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:53:46.044028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:46.146600 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65060f-28cc-487b-a984-366ff06445d5 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:53:46.152806 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:53:46.153474 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:46.153750 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:46.154023 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:46.155970 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:46.169114 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:53:46.170728 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40f558-afe2-4209-8d35-2a7f6e54e640 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:53:46.181560 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1431/2874] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:53:51.545290 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] REQUEST_METHOD: `POST` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:53:51.545826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:53:51.545826 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:53:51.565857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.auth.core [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] MFA Rules not processed for user `8c3c4d82d3f7427083bab52696d8ec60`. Rule list: `[]` (Enabled: `True`). {{(pid=88172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:53:51.567058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:53:51.624353 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1444/2875] 10.222.0.93 () {58 vars in 958 bytes} [Wed Aug 24 15:53:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:53:56.176713 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=41 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:01.616748 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=25 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:04.517550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72f93-2e52-4976-8730-b4dc0cf70ba5 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:04.517550 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72f93-2e52-4976-8730-b4dc0cf70ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:04.518257 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72f93-2e52-4976-8730-b4dc0cf70ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:04.539204 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-4ad72f93-2e52-4976-8730-b4dc0cf70ba5 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:04.540417 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4ad72f93-2e52-4976-8730-b4dc0cf70ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:04.549636 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1432/2876] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:04.566614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:04.580810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f824-dae9-4e68-aee4-af6418b66e35 None None] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:04.586983 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:04.587744 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:04.588041 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:04.588326 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:04.597101 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:04.598695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:04.609323 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1445/2877] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:07.825327 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16db4-9c92-44bd-8804-df5687f2fbca None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:07.825914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16db4-9c92-44bd-8804-df5687f2fbca None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:07.825914 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e16db4-9c92-44bd-8804-df5687f2fbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:07.850684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-37e16db4-9c92-44bd-8804-df5687f2fbca None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:07.851906 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-37e16db4-9c92-44bd-8804-df5687f2fbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:07.860628 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1433/2878] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:07.876778 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:07.888742 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb79d-1f6e-46c7-b6dd-cbbd50f4fb11 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:07.896037 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:07.896639 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:07.896885 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:07.897192 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:07.906055 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:07.907614 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:07.917201 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1446/2879] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:10.901266 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc02d-41f1-43f5-9324-3b0668cd6db3 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:10.901897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc02d-41f1-43f5-9324-3b0668cd6db3 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:10.901897 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc02d-41f1-43f5-9324-3b0668cd6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:10.930501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-57bcc02d-41f1-43f5-9324-3b0668cd6db3 None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:10.930501 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-57bcc02d-41f1-43f5-9324-3b0668cd6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:10.943499 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1434/2880] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:10.960095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:10.972282 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599beb9-d764-4409-8a14-17b4125b0ba9 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:10.978595 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:10.979195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:10.979467 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:10.979734 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:10.988058 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:10.989679 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:11.002924 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1447/2881] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:54:14.089746 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d73c-2814-4754-b6e0-5a9155f142af None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:14.092091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d73c-2814-4754-b6e0-5a9155f142af None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:14.092091 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d73c-2814-4754-b6e0-5a9155f142af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:14.115303 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-a922d73c-2814-4754-b6e0-5a9155f142af None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:14.116504 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-a922d73c-2814-4754-b6e0-5a9155f142af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:14.126112 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1435/2882] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:14.144337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:14.155967 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba007fa-65a4-47bd-9f83-0a4b227e8f33 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:14.162866 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:14.163505 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:14.163784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:14.164053 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:14.172810 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:14.174459 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:14.184274 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1448/2883] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:17.278618 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9dfa-cf7f-47c4-8843-67619cb8e04f None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:17.279208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9dfa-cf7f-47c4-8843-67619cb8e04f None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:17.279208 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9dfa-cf7f-47c4-8843-67619cb8e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:17.301749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-347f9dfa-cf7f-47c4-8843-67619cb8e04f None None] MFA Rules not processed for user `61343595c90645119bdcdf769e315d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:17.302949 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-347f9dfa-cf7f-47c4-8843-67619cb8e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:17.312820 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1436/2884] 10.222.0.99 () {58 vars in 1016 bytes} [Wed Aug 24 15:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:17.331035 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:17.342806 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a603-8548-401a-a4f4-b9abeacabbb5 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:17.348604 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:17.349354 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:17.349624 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:17.349874 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:17.358562 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:17.360143 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:17.369832 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1449/2885] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:27.295684 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=15 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:27.365495 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=30 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:32.260438 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] REQUEST_METHOD: `POST` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:32.260917 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:32.261028 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:32.292944 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.auth.core [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] MFA Rules not processed for user `a75d087fed3c4c289db13b0344b3b422`. Rule list: `[]` (Enabled: `True`). {{(pid=88171) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:54:32.294060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:32.365686 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1437/2886] 10.222.0.93 () {58 vars in 967 bytes} [Wed Aug 24 15:54:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:54:32.410628 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:32.412151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:32.486699 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa090d7-6ce8-45d7-98a8-d140ec7c996d service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:32.493141 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dcdde810504ecf963f7b4abc93270c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:32.493754 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:32.494029 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:32.494298 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:32.503685 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:32.505350 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:32.513746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1450/2887] 10.222.0.93 () {60 vars in 1384 bytes} [Wed Aug 24 15:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:54:39.169649 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:39.182875 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10a64-8cd1-47d9-b058-5c01ea4601a7 None None] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:39.188388 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:39.189056 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:39.189338 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:39.189611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:39.191635 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:39.214368 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:39.216131 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:39.238314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:39.238314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:39.246814 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1438/2888] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:54:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:54:39.251017 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbae2f-ee73-4372-ae3f-f4377ab85789 service swift] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:39.256018 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:39.256666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:39.256982 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:39.257249 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] PATH_INFO: `/v3/users/510b6f993c4c47c59c936e3493d63fec` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:39.258819 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510b6f993c4c47c59c936e3493d63fec)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:39.260352 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:39.309440 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510b6f993c4c47c59c936e3493d63fec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.310075 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510b6f993c4c47c59c936e3493d63fec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.310695 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510b6f993c4c47c59c936e3493d63fec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.322567 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510b6f993c4c47c59c936e3493d63fec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.332195 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510b6f993c4c47c59c936e3493d63fec'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.347235 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1451/2889] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:54:39 2022] DELETE /identity/v3/users/510b6f993c4c47c59c936e3493d63fec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:39.535125 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:39.552102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe49778-43a3-4002-a5cb-77babbbab48e service placement] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:39.645024 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:39.645788 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:39.646070 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:39.646345 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] PATH_INFO: `/v3/projects/66a9e1bac95741b48ebc46222814622d` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:39.647503 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a9e1bac95741b48ebc46222814622d)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:39.649799 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:39.704219 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a9e1bac95741b48ebc46222814622d', 'request_id': 'req-2145b942-7772-431c-b690-e39480506d5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.713341 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a9e1bac95741b48ebc46222814622d', 'request_id': 'req-2145b942-7772-431c-b690-e39480506d5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.720145 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a9e1bac95741b48ebc46222814622d', 'request_id': 'req-2145b942-7772-431c-b690-e39480506d5f'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.730391 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] The token cache is being invalidate because project 66a9e1bac95741b48ebc46222814622d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:54:39.730674 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.731374 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.732878 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1439/2890] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:54:39 2022] DELETE /identity/v3/projects/66a9e1bac95741b48ebc46222814622d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:39.737193 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:39.738651 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:39.752220 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a9df8-3819-4528-9e03-615109b0a694 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:39.827590 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:39.828532 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:39.828831 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:39.829253 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] PATH_INFO: `/v3/users/894ec839b6ed49d195e035ab09d1fd6d` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:39.830693 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894ec839b6ed49d195e035ab09d1fd6d)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:39.832703 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:39.835484 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:39.887750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894ec839b6ed49d195e035ab09d1fd6d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.888398 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894ec839b6ed49d195e035ab09d1fd6d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.889022 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894ec839b6ed49d195e035ab09d1fd6d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.901401 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894ec839b6ed49d195e035ab09d1fd6d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.911815 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894ec839b6ed49d195e035ab09d1fd6d'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:39.925498 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1452/2891] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:54:39 2022] DELETE /identity/v3/users/894ec839b6ed49d195e035ab09d1fd6d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:40.115883 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:40.117481 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:40.132067 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b942-7772-431c-b690-e39480506d5f admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:40.144259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:40.203102 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:40.203826 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:40.204018 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:40.204289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] PATH_INFO: `/v3/projects/480d858275c2420f9e3c87f660755ecc` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:40.205587 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=480d858275c2420f9e3c87f660755ecc)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:40.207538 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:40.259239 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480d858275c2420f9e3c87f660755ecc', 'request_id': 'req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:40.269236 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480d858275c2420f9e3c87f660755ecc', 'request_id': 'req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:40.275749 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480d858275c2420f9e3c87f660755ecc', 'request_id': 'req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:40.286124 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] The token cache is being invalidate because project 480d858275c2420f9e3c87f660755ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:54:40.286408 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:40.287046 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:40.288575 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1440/2892] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:54:40 2022] DELETE /identity/v3/projects/480d858275c2420f9e3c87f660755ecc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:47.173880 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:47.175337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:47.189222 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b99cc9-12f2-4b67-9663-157e9eb39dc2 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:47.251741 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:47.253057 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:47.253337 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:47.253607 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] PATH_INFO: `/v3/users/8c3c4d82d3f7427083bab52696d8ec60` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:47.254750 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3c4d82d3f7427083bab52696d8ec60)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:47.256746 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:47.312335 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3c4d82d3f7427083bab52696d8ec60'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.313008 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3c4d82d3f7427083bab52696d8ec60'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.313663 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3c4d82d3f7427083bab52696d8ec60'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.326798 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3c4d82d3f7427083bab52696d8ec60'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.336304 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3c4d82d3f7427083bab52696d8ec60'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.345830 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:47.350564 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1453/2893] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:54:47 2022] DELETE /identity/v3/users/8c3c4d82d3f7427083bab52696d8ec60 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:47.550296 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:54:47.551960 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:54:47.565431 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc5ca1-4b77-4b81-98f2-78e8eb31b9db admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:54:47.623702 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:54:47.624263 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:54:47.624525 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:54:47.624800 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] PATH_INFO: `/v3/projects/7dc8ef32ffad4d45828b674feee0adc0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:54:47.625971 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc8ef32ffad4d45828b674feee0adc0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:54:47.627882 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:54:47.683877 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:47.686936 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc8ef32ffad4d45828b674feee0adc0', 'request_id': 'req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.697888 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc8ef32ffad4d45828b674feee0adc0', 'request_id': 'req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.704935 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc8ef32ffad4d45828b674feee0adc0', 'request_id': 'req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.716003 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] The token cache is being invalidate because project 7dc8ef32ffad4d45828b674feee0adc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:54:47.716285 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.717154 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:54:47.718850 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1441/2894] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:54:47 2022] DELETE /identity/v3/projects/7dc8ef32ffad4d45828b674feee0adc0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:54:57.712962 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:20.364316 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:20.366066 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:20.454784 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d338f15-6f7c-4700-8883-2bf8c1b2cfd7 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:20.505185 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:20.505802 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:20.506077 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:20.506344 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:20.508162 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:20.585131 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:20.586763 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:20.598374 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1454/2895] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:21.811151 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:21.812956 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:21.827590 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28aca0-44c8-4c64-8e44-3bc105a1af5c admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:21.832001 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:21.832616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:21.832932 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:21.833200 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:21.835331 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:21.851367 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:21.852843 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:21.865326 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1442/2896] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:30.309674 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:30.311450 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:30.323030 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83617aa2-a05d-40e1-8e58-96fa610cf87e service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:30.326111 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:30.326732 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:30.326996 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:30.327264 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:30.329095 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:30.339825 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:30.341552 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:30.350118 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1455/2897] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:31.859645 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=6 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:32.882881 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:32.892202 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0fd2-42ac-4d2b-868d-f79b45ba32fa service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:32.896854 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:32.897571 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:32.897867 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:32.898104 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:32.899989 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:32.911796 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:32.913812 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:32.922611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1443/2898] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:33.005406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:33.015503 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7a2e8-dce2-4028-844f-70a7ed6bf737 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:33.019946 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6987a8308864fb599f4a2a2ecfa226a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:33.020829 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:33.021137 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:33.021404 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:33.023202 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:33.045151 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:33.046596 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:33.057556 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1456/2899] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:33.126297 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:55:33.127987 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:33.209016 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9454-2a9a-42d3-80bf-2c1843f8cbc9 service neutron] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:55:33.215502 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:55:33.216172 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:55:33.216447 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:55:33.216742 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:55:33.218756 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:55:33.231181 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:55:33.232775 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:55:33.243038 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1444/2900] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:55:43.053009 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=95 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:43.238461 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=38 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:56:51.406609 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:51.408159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:51.424183 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981341c0-dd5b-4467-b010-48ec0dd637b0 service neutron] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:51.430054 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79b6528e8e264539aae69a23f7e2b4e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:51.430666 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:51.430938 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:51.431204 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:51.433705 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:51.447482 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:51.448625 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:51.459903 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1457/2901] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:56:58.223120 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:56:58.238808 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576ea7-c0a6-4349-84de-d88d008ccfc5 service placement] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:56:58.245242 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:56:58.246092 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] REQUEST_METHOD: `GET` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:56:58.247660 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:56:58.248060 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:56:58.253138 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:56:58.271568 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:56:58.273260 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:56:58.292315 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1445/2902] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:56:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:57:01.455962 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=6 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:01.976710 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:01.979698 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:02.050588 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756e2a7-3b66-4acf-b3fe-fbe680e8c787 service nova] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:02.056446 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:02.057406 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:02.057717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:02.057987 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] PATH_INFO: `/v3/users/aa8de8be287b4beabf33b2d7959c81bb` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:02.059139 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8de8be287b4beabf33b2d7959c81bb)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:02.061110 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:02.108229 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8de8be287b4beabf33b2d7959c81bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.108870 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8de8be287b4beabf33b2d7959c81bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.109494 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8de8be287b4beabf33b2d7959c81bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.122969 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8de8be287b4beabf33b2d7959c81bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.132341 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8de8be287b4beabf33b2d7959c81bb'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.145691 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1458/2903] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:57:01 2022] DELETE /identity/v3/users/aa8de8be287b4beabf33b2d7959c81bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:57:02.333203 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:02.347802 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8123-3e98-4d71-b1d1-436421ae6d46 service placement] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:02.409611 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:02.410243 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:02.410523 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:02.410780 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] PATH_INFO: `/v3/projects/a9be156e93964d7c8de073f38b666ea9` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:02.411890 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9be156e93964d7c8de073f38b666ea9)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:02.413840 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:02.463627 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9be156e93964d7c8de073f38b666ea9', 'request_id': 'req-4ae9d234-a921-45c3-a3c9-9f22a95644fa'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.477019 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9be156e93964d7c8de073f38b666ea9', 'request_id': 'req-4ae9d234-a921-45c3-a3c9-9f22a95644fa'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.483880 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9be156e93964d7c8de073f38b666ea9', 'request_id': 'req-4ae9d234-a921-45c3-a3c9-9f22a95644fa'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.495923 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] The token cache is being invalidate because project a9be156e93964d7c8de073f38b666ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:57:02.496247 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.497007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.498681 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1446/2904] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:57:02 2022] DELETE /identity/v3/projects/a9be156e93964d7c8de073f38b666ea9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:57:02.504592 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:02.506188 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:02.524325 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66b07e-331e-46fd-ba80-afe0dc07e8ff admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:02.584159 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:02.584788 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:02.585085 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:02.585349 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] PATH_INFO: `/v3/users/a13ee034e55c4e5ab6e2a5617f355569` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:02.586765 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13ee034e55c4e5ab6e2a5617f355569)` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:02.588687 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:02.611469 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:02.644178 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13ee034e55c4e5ab6e2a5617f355569'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.644936 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13ee034e55c4e5ab6e2a5617f355569'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.645599 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13ee034e55c4e5ab6e2a5617f355569'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.657530 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13ee034e55c4e5ab6e2a5617f355569'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.666412 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.notifications [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13ee034e55c4e5ab6e2a5617f355569'} {{(pid=88172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:02.678893 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1459/2905] 10.222.0.93 () {58 vars in 1224 bytes} [Wed Aug 24 15:57:02 2022] DELETE /identity/v3/users/a13ee034e55c4e5ab6e2a5617f355569 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:57:02.859383 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Authenticating user token {{(pid=88171) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:57:02.860938 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.fernet_utils [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88171) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:57:02.882021 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d234-a921-45c3-a3c9-9f22a95644fa admin admin] Validating token access rules against request {{(pid=88171) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:57:02.944259 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61343595c90645119bdcdf769e315d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91eb9a5b14d843409de915748f661903', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88171) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:57:02.945289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:57:02.945289 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:57:02.945752 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] PATH_INFO: `/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0` {{(pid=88171) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:57:02.947087 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8291ca79c5a4b4aafe40717444c0cd0)` {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:57:02.949140 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] RBAC: Authorization granted {{(pid=88171) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:57:02.976121 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:03.011753 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8291ca79c5a4b4aafe40717444c0cd0', 'request_id': 'req-9b06ae2f-e919-4a8e-a562-1018bf2b2488'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:03.031007 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8291ca79c5a4b4aafe40717444c0cd0', 'request_id': 'req-9b06ae2f-e919-4a8e-a562-1018bf2b2488'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:03.041616 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8291ca79c5a4b4aafe40717444c0cd0', 'request_id': 'req-9b06ae2f-e919-4a8e-a562-1018bf2b2488'} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:03.056652 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] The token cache is being invalidate because project f8291ca79c5a4b4aafe40717444c0cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88171) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:57:03.056955 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:03.057694 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG keystone.notifications [None req-9b06ae2f-e919-4a8e-a562-1018bf2b2488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88171) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:57:03.059366 dv-cinder-846054-2-smb devstack@keystone.service[88171]: [pid: 88171|app: 0|req: 1447/2906] 10.222.0.93 () {58 vars in 1233 bytes} [Wed Aug 24 15:57:02 2022] DELETE /identity/v3/projects/f8291ca79c5a4b4aafe40717444c0cd0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:57:12.675610 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:13.051809 dv-cinder-846054-2-smb devstack@keystone.service[88171]: DEBUG dbcounter [-] [88171] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:16.860717 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Authenticating user token {{(pid=88172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:59:16.862661 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:16.936072 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d67a-1e18-4de0-932b-821e9301ce86 admin admin] Validating token access rules against request {{(pid=88172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:59:17.004114 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '176b283110c240159bbc525fd6745f1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f01959633ac24d5abc4182c7827a5aa8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:59:17.004730 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] REQUEST_METHOD: `GET` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:59:17.005039 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] SCRIPT_NAME: `/identity` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:59:17.005314 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:59:17.007200 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.fernet_utils [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:59:17.019279 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:59:17.020868 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d673fc6-f158-4416-bba2-ea1152e51bfd service placement] RBAC: Authorization granted {{(pid=88172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:59:17.030857 dv-cinder-846054-2-smb devstack@keystone.service[88172]: [pid: 88172|app: 0|req: 1460/2907] 10.222.0.93 () {60 vars in 1365 bytes} [Wed Aug 24 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:59:27.026856 dv-cinder-846054-2-smb devstack@keystone.service[88172]: DEBUG dbcounter [-] [88172] Writing DB stats keystone:SELECT=58 {{(pid=88172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}